-- Logs begin at Wed 2022-07-13 21:25:42 UTC, end at Wed 2022-07-13 22:27:14 UTC. -- Jul 13 21:57:23.877320 dv-cinder-799871-28-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 13 21:57:23.885881 dv-cinder-799871-28-smb devstack@keystone.service[80402]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 13 21:57:23 2022] *** Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: nodename: dv-cinder-799871-28-smb Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: machine: x86_64 Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: clock source: unix Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: pcre jit disabled Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: detected number of CPU cores: 4 Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: current working directory: / Jul 13 21:57:23.887879 dv-cinder-799871-28-smb devstack@keystone.service[80402]: detected binary path: /usr/bin/uwsgi-core Jul 13 21:57:23.888531 dv-cinder-799871-28-smb devstack@keystone.service[80402]: your processes number limit is 47680 Jul 13 21:57:23.888531 dv-cinder-799871-28-smb devstack@keystone.service[80402]: your memory page size is 4096 bytes Jul 13 21:57:23.888531 dv-cinder-799871-28-smb devstack@keystone.service[80402]: detected max file descriptor number: 2048 Jul 13 21:57:23.888531 dv-cinder-799871-28-smb devstack@keystone.service[80402]: lock engine: pthread robust mutexes Jul 13 21:57:23.888531 dv-cinder-799871-28-smb devstack@keystone.service[80402]: thunder lock: enabled Jul 13 21:57:23.888531 dv-cinder-799871-28-smb devstack@keystone.service[80402]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 13 21:57:23.888531 dv-cinder-799871-28-smb devstack@keystone.service[80402]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 13 21:57:23.932325 dv-cinder-799871-28-smb devstack@keystone.service[80402]: Python main interpreter initialized at 0x557a36c2f9c0 Jul 13 21:57:23.932325 dv-cinder-799871-28-smb devstack@keystone.service[80402]: python threads support enabled Jul 13 21:57:23.932325 dv-cinder-799871-28-smb devstack@keystone.service[80402]: your server socket listen backlog is limited to 100 connections Jul 13 21:57:23.932325 dv-cinder-799871-28-smb devstack@keystone.service[80402]: your mercy for graceful operations on workers is 90 seconds Jul 13 21:57:23.932708 dv-cinder-799871-28-smb devstack@keystone.service[80402]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 21:57:23.932788 dv-cinder-799871-28-smb devstack@keystone.service[80402]: *** Operational MODE: preforking *** Jul 13 21:57:23.933038 dv-cinder-799871-28-smb devstack@keystone.service[80402]: *** uWSGI is running in multiple interpreter mode *** Jul 13 21:57:23.933038 dv-cinder-799871-28-smb devstack@keystone.service[80402]: spawned uWSGI master process (pid: 80402) Jul 13 21:57:23.933244 dv-cinder-799871-28-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 13 21:57:23.935943 dv-cinder-799871-28-smb devstack@keystone.service[80402]: spawned uWSGI worker 1 (pid: 80410, cores: 1) Jul 13 21:57:23.935943 dv-cinder-799871-28-smb devstack@keystone.service[80402]: spawned uWSGI worker 2 (pid: 80411, cores: 1) Jul 13 21:57:23.935943 dv-cinder-799871-28-smb devstack@keystone.service[80402]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 21:57:29.354414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 21:57:29.354414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: from cryptography.utils import int_from_bytes Jul 13 21:57:29.355213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 21:57:29.355213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: from cryptography.utils import int_from_bytes Jul 13 21:57:29.355325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 21:57:29.355325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: from cryptography.utils import int_from_bytes Jul 13 21:57:29.355728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 21:57:29.355728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: from cryptography.utils import int_from_bytes Jul 13 21:57:29.403804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 21:57:29.404075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 21:57:29.404158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 21:57:29.404241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 21:57:29.404316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] command line args: [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 21:57:29.404393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] command line args: [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 21:57:29.404459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 21:57:29.404539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 21:57:29.404616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ================================================================================ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 21:57:29.404692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ================================================================================ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 21:57:29.404806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] admin_token = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.404922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] admin_token = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.405067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] config_dir = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.405148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] config_dir = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.405275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.405359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.405425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] config_source = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.405492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] config_source = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.405648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] debug = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.405733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] debug = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.405800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.406969 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_config_append = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_config_append = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_dir = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_dir = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_file = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_file = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.407941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.408116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.408216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.408349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.408451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.408598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.408704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.408783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.408859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.408946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.409076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.409164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.409246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.409430 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.409525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.409641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.409738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.409865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.409969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.410087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.410182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.410315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.410400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.410555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.410634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.410796 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.410886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.411065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.411144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.411543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.411624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.411705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] publish_errors = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.411781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] publish_errors = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.411962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.412060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.412194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.412314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.412407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.412525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.412608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.412701 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.412811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.412891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] standard_threads = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] standard_threads = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413494 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_journal = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413907 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_journal = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.413979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_json = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.414054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_json = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.414152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_stderr = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.414238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_stderr = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.414311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] use_syslog = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.414381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] use_syslog = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.414538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.414623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 21:57:29.414856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.414996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.415099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.415267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.415393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.415531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.415610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.415771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.415850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.416057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.416136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.416296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.416377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.416534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.416614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.416767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.416844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.417016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.417095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.417262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.417347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.417497 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.417575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.417728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.417804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.417966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.418051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.418198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.418277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.418442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.418520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.418749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.418828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.418906 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.418977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.419143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.419223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.419390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.419469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.419628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.419707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.419858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.419997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.420136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.420223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.420394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.420473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.420643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.420720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.420876 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.420961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.421106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.421184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.421337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.421423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.421564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.421643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.421798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.421875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.422043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.422131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.422273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.422352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.422497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.422580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.422725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.422812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.422968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.423054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.423202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.423279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.423432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.423517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.423666 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.423743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.423891 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.423985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.424145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.424305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.424382 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.424452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.424590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.424669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.424816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.424902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.425039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.425116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.425265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.425342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.425498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.425584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.425727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.425810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.425954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.426069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.426182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.426267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.426399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.426480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.426631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.426709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.426863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.426951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.427091 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.427193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.427320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.427421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.427548 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.427655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.427752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.427962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.428984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.429133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.429218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.429362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.429453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.429606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.429738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.429850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.429952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.430082 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.430162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.430846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.430927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.431090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.431267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.431386 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.431484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.431597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.431673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.431825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.431928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.432096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.432176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.432336 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.432425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.432573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.432654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.432803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.432885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.433037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.433157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.433386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.433466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.433624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.433707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.433859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.433939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.434100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.434180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.434331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.434410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.434563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.434642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.434797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.434878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.435029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.435107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.435261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.435340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.435518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.435597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.435752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.435832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.436013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.436094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.436290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.436370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.436472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.436553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.436705 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.436785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.436939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.437029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.437171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.437251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.437397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.437475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.437625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.437704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.437852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.437932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.438081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.438171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.438305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.438385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.438540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.438621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.438774 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.438853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.439011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.439090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.439240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.439320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.439493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.439573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.439744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.439830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.440006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.external = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.440088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.440236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.external = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.440324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.440465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.440553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.440750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.440844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.440976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.441056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.password = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.441204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.password = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.441284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] auth.token = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.441430 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] auth.token = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.441522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.441664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.441743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.441900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.441978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.442130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.442217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.442355 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.442434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.442599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.442685 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.442830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.442920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.443053 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.443132 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.443284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.443368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.443528 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.443616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.443772 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.443852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.444031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.444124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.444265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.444353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.444500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.444580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.444729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.444808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.444988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.445081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.445230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.445310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.445459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.445538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.445707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.445795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.446550 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.446634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.446819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.446907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.447061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.447149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.447317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.447398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.447552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.447633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.447789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.447878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.448063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.448146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.448309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.448401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.448541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.448630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.448781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.448861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.449017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.449096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.449250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.449338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.449496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.449576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.449727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.449806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.449973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.450061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.450205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.450284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.450441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.450520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.450671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.450822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.450900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.450973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.451146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.451225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.451375 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.451455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.451609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.451690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.451838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.451974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.452099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.452182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.452331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.452409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.452575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.452656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.452805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.452885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.453035 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.453114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.453262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.453342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.453488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.453576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.453728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.453809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.453970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.454050 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.454213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.454295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.454457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.454536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.454697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.454776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.454951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.455031 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.455187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.455266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.455421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.455531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.455649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.455787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.455930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.456054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.456183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.456311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.456449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.456578 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.456578 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.456822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.456945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.457072 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.457208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.457343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.457471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.457600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.457734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.457862 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.457998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.458126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.458253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.458379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.458507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.458634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.458769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.458905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.459034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.459174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.459302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.459430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.459565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.459693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.459820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.459974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.460098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.460475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.460610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.460738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.460865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.460992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.461130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.461258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.461393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.461480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.461634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.461758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.461886 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.462056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.462212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.462342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.462469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.462597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.462725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.462852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.462997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.463125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.463254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.463382 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.463510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.463646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.463775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.463918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.464044 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.464171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.464336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.464472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.464602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.464602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.464852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.464980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.465107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.465243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.465373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.465500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.465626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.465753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.465879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.466013 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.466142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.466270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.466397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.466533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.466666 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.466805 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.466932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.467059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.467187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.467314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.467442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.467576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.467704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.467831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.467971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.468109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.468237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.468382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.468511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.468637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.468764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.468890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.469017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.469152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.469278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.469411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.469539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.469665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.469792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.469928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.470062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.470198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.470325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.470452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.470580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.470714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.470849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.470976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.471103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.471229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.471364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.471499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.471628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.471756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.471893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.472069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.472193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.472326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.472451 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.472575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.472699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.472823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.472946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.473077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.473202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.473325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.473448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.473572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.473706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.473838 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.473963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.474086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.474209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.474332 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.474455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.474591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.474716 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.474840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.474963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.475085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.475085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.475391 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.475527 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.475651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.475776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] role.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.475950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.476076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] role.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.476215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] role.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.476344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.476471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] role.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.476597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.476729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.476850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.476986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.477624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.477760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.477887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.478013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.478148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.478272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.478400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.478527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.478655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.478782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.478918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.479046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.479173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.479300 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.479426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.479564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.479699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.479828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.479971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.480095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.480219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.480342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.480342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.480587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.480587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.480818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.480818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.481051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.481193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.481319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.481442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.481565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.481689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.481812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.481942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.482068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.482192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.482315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.482439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.482562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.482694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.482831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.482956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.483081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.483204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.483336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.483460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.483583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.483707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.483830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.483975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.484111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.484237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.484359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.484492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.484616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.484739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.484871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.484995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.485118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.485242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.485365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.485487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.485618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.485743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.485865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.485988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.486112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.486245 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.486377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.486501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.486626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.486753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.486876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.487000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.487131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.487256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.487380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.487505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.487628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.487751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.488165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.488305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.488435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.488562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.488690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.488817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.488953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.489081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.489207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.489335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.489462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.489590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.489726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.489861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.489998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.490127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.490254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.490390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.490532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.490667 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.490795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.490930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.491058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.491184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.491311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.491440 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.491568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.491703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.491840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.491997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.492123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.492247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.492371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.492505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.492630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.492630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.493444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.493572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.493732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.493896 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.494023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.494148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.494284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.494410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.494535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.494669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.494796 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.494921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.495046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.495170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.495294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.495426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.495551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.495677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 21:57:29.495803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 21:57:29.495803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 21:57:29.520937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.521142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.521279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.521408 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.521535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.521665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.529722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.529895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.559082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.559315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.559834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.560089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.701815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.702101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.752078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.752313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.752473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.752692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.816343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.816564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.816790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.816939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.817076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.817209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.817334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.817459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.817584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.817722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.817722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.817965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.842679 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.842900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.843076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.843205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.843330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.843453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.843576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.843708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.843833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.843985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.844112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.844250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.844374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.844508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.855080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.855266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.868286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.868604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.868768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.868916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.869051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.869182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.869182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.869449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.869578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.869578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80410) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.869816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.870010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.870391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.870785 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 21:57:29.887049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.887255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 21:57:29.887419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.887558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 21:57:29.887825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.888060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 21:57:29.888196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.888327 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 21:57:29.888454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.888593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.888720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.888848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.888974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.889100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.889238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.889373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.900546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.900750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.900880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.901011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.901141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.901285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.901439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.901567 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.909559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.909733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.912875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.913008 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.913161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.913290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.913442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.913581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.913709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.913843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.913979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.914107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.914252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.914380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.914506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.915232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.915366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.915492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.915629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.915757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.915883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.916039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.916176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.916320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.942526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.942676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.944147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.944308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.944451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.944579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.949781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.949921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.950049 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.950188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.950326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.950453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.957736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.957887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.958013 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.958149 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.963314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.963454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.963583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.963709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.963861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.964011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.964137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.964263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.964389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.964515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.964649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.964775 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.964900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.965026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.965151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.965294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.984241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.984504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.984635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.984786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.989051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.989472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.992695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.992995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.993367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.993659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:29.998252 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:29.998848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.001852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.002470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.005498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.005792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.006080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.006162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.006362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.006457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.006654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.006737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.006929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.007011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.007218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.007501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.026585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.026856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.027093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.027176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.027366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.027448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.027628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.027915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.035239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.035797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.036958 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.037231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.037506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.037784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.040625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.040902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.041060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.041181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.041338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.041458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.041616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.041741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.041895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.042170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.054950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.055770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.056075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.056181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.056352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.056443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.056627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.056708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.056912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.057063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.057197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.057349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.057483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.057721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.076398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.076998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.079670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.080377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.082961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.083682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.084582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.085560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.087109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.087384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.087750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.087981 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.088265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.088551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.095057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.095828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.096704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.097482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.099927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.100218 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.100497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.100738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.100866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.101038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.101323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.101600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.110238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.110529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.110814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.110932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.111220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.111498 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.119272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.119547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.119820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.119959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80410) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 21:57:30.120119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.120241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.120387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.120521 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.120660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.120793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.120946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.121060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.121218 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.121328 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.121587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.121678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.121858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.121943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.122132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.122213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.122393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.122482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.122657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.122739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.122924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.123004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.123249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.123529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80410) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 21:57:30.161315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557a36c2f9c0 pid: 80411 (default app) Jul 13 21:57:30.161767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557a36c2f9c0 pid: 80410 (default app) Jul 13 21:57:30.164887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c747b8-bf3f-4b6f-8633-6a87253af84f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:30.164887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c747b8-bf3f-4b6f-8633-6a87253af84f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:30.165423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c747b8-bf3f-4b6f-8633-6a87253af84f None None] PATH_INFO: `/v3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:30.169588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Wed Jul 13 21:57:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:37.844433 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f6a6-57fa-4d17-a4b3-f51fc0d1fa87 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:37.845044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f6a6-57fa-4d17-a4b3-f51fc0d1fa87 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:37.845141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f6a6-57fa-4d17-a4b3-f51fc0d1fa87 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:37.849405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:57:37.855212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:37.855656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:37.855774 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:37.925346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: INFO dbcounter [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] Registered counter for database keystone Jul 13 21:57:37.948625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG oslo_db.sqlalchemy.engines [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:57:37.955226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writer thread running {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:57:38.135373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG passlib.handlers.bcrypt [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80411) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 21:57:38.135793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG passlib.handlers.bcrypt [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80411) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 21:57:38.189614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:38.191259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:38.313422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 13 21:57:38.521823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765f6a6-57fa-4d17-a4b3-f51fc0d1fa87 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:38.592853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: INFO dbcounter [None req-1765f6a6-57fa-4d17-a4b3-f51fc0d1fa87 None None] Registered counter for database keystone Jul 13 21:57:38.611772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG oslo_db.sqlalchemy.engines [None req-1765f6a6-57fa-4d17-a4b3-f51fc0d1fa87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 21:57:38.617957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writer thread running {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 21:57:38.736301 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765f6a6-57fa-4d17-a4b3-f51fc0d1fa87 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:38.740619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e874b-fae3-4cf2-8fcd-8a43590694ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:38.741282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e874b-fae3-4cf2-8fcd-8a43590694ce admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:38.741570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e874b-fae3-4cf2-8fcd-8a43590694ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:38.741851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e874b-fae3-4cf2-8fcd-8a43590694ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:38.750659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e874b-fae3-4cf2-8fcd-8a43590694ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:38.801437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c79e874b-fae3-4cf2-8fcd-8a43590694ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 21:57:38.801724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e874b-fae3-4cf2-8fcd-8a43590694ce admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:38.811306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Jul 13 21:57:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 21:57:38.817319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:38.832205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222cb67-1aa9-435a-8028-cfafda223670 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:38.837490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cbf2e-9476-4b57-ab7d-a5b11823db1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:38.838618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cbf2e-9476-4b57-ab7d-a5b11823db1a admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:38.838913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cbf2e-9476-4b57-ab7d-a5b11823db1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:38.839195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cbf2e-9476-4b57-ab7d-a5b11823db1a admin admin] PATH_INFO: `/v3/projects/fccb2b976d33488897e5b5707f7da2b4` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:38.840693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cbf2e-9476-4b57-ab7d-a5b11823db1a admin admin] RBAC: Authorizing `identity:get_project(project_id=fccb2b976d33488897e5b5707f7da2b4)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:38.894119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING keystone.common.rbac_enforcer.enforcer [None req-579cbf2e-9476-4b57-ab7d-a5b11823db1a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 21:57:38.894687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cbf2e-9476-4b57-ab7d-a5b11823db1a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:38.899233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Wed Jul 13 21:57:38 2022] GET /identity/v3/projects/fccb2b976d33488897e5b5707f7da2b4 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:40.925786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b3945-422b-4871-9f70-4703cf214cdd None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:40.926326 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b3945-422b-4871-9f70-4703cf214cdd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:40.926715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b3945-422b-4871-9f70-4703cf214cdd None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:40.934481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:40.940202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142e6d-48df-4d86-aeb7-6caeef5e7bf1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:40.940866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142e6d-48df-4d86-aeb7-6caeef5e7bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:40.940960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142e6d-48df-4d86-aeb7-6caeef5e7bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:40.961938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3d142e6d-48df-4d86-aeb7-6caeef5e7bf1 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:40.964330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3d142e6d-48df-4d86-aeb7-6caeef5e7bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:40.973097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 13 21:57:40.998168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b3945-422b-4871-9f70-4703cf214cdd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:41.012099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b3945-422b-4871-9f70-4703cf214cdd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:41.018244 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f729b-463d-4560-9c53-ea76e1fc84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:41.019274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f729b-463d-4560-9c53-ea76e1fc84d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:41.019744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f729b-463d-4560-9c53-ea76e1fc84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:41.020258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f729b-463d-4560-9c53-ea76e1fc84d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:41.030704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f729b-463d-4560-9c53-ea76e1fc84d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:41.033171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f729b-463d-4560-9c53-ea76e1fc84d5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:41.043000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Jul 13 21:57:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 21:57:41.049241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142e6d-48df-4d86-aeb7-6caeef5e7bf1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:41.059797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142e6d-48df-4d86-aeb7-6caeef5e7bf1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:41.066279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fa6f7-d714-4fba-aac7-a7deed41c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:41.067691 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa6f7-d714-4fba-aac7-a7deed41c862 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:41.068213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa6f7-d714-4fba-aac7-a7deed41c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:41.068689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa6f7-d714-4fba-aac7-a7deed41c862 admin admin] PATH_INFO: `/v3/users/9a1c8175bf58440a96c9e02fcf618584` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:41.070954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fa6f7-d714-4fba-aac7-a7deed41c862 admin admin] RBAC: Authorizing `identity:get_user(user_id=9a1c8175bf58440a96c9e02fcf618584)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:41.073321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fa6f7-d714-4fba-aac7-a7deed41c862 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:41.074926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Wed Jul 13 21:57:41 2022] GET /identity/v3/users/9a1c8175bf58440a96c9e02fcf618584 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:43.235300 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1fb80-5f68-4084-b95e-e8d7e83feabf None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.235805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1fb80-5f68-4084-b95e-e8d7e83feabf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.235938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1fb80-5f68-4084-b95e-e8d7e83feabf None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.237325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:43.242623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefd47d-f1bd-4013-ae88-be81af250537 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.243037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefd47d-f1bd-4013-ae88-be81af250537 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.243187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefd47d-f1bd-4013-ae88-be81af250537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.254521 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048aa47-9312-4588-ac55-a3e10890fd9c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.254807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048aa47-9312-4588-ac55-a3e10890fd9c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.255089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048aa47-9312-4588-ac55-a3e10890fd9c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.256443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:57:43.260304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-caefd47d-f1bd-4013-ae88-be81af250537 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:43.261510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-caefd47d-f1bd-4013-ae88-be81af250537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:43.261892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765275c3-dfdc-497f-96a8-354ed8dff696 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.262181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765275c3-dfdc-497f-96a8-354ed8dff696 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.262459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765275c3-dfdc-497f-96a8-354ed8dff696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.301470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG passlib.handlers.bcrypt [None req-765275c3-dfdc-497f-96a8-354ed8dff696 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80410) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 21:57:43.301912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG passlib.handlers.bcrypt [None req-765275c3-dfdc-497f-96a8-354ed8dff696 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80410) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 21:57:43.345117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:57:43.348487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-765275c3-dfdc-497f-96a8-354ed8dff696 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:43.350105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-765275c3-dfdc-497f-96a8-354ed8dff696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:43.369162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefd47d-f1bd-4013-ae88-be81af250537 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:43.396177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:43.450482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:57:43.473103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765275c3-dfdc-497f-96a8-354ed8dff696 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:43.474894 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefd47d-f1bd-4013-ae88-be81af250537 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:43.508806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e550b-6238-45ac-8f52-048fcdb72c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:43.509665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e550b-6238-45ac-8f52-048fcdb72c74 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.509959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e550b-6238-45ac-8f52-048fcdb72c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.510242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e550b-6238-45ac-8f52-048fcdb72c74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.521431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e550b-6238-45ac-8f52-048fcdb72c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-cb4e550b-6238-45ac-8f52-048fcdb72c74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:57:43.533371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:57:43.534284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:57:43.535221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:57:43.541508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e550b-6238-45ac-8f52-048fcdb72c74 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:43.572506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765275c3-dfdc-497f-96a8-354ed8dff696 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:43.574917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:43.611151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9732761-c5e2-443b-967b-c6fc8ab5d37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:43.612091 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9732761-c5e2-443b-967b-c6fc8ab5d37d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.612391 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9732761-c5e2-443b-967b-c6fc8ab5d37d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.612668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9732761-c5e2-443b-967b-c6fc8ab5d37d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.624220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:43.642156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e550b-6238-45ac-8f52-048fcdb72c74 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:43.675791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524001d-e0c3-48bd-83b5-8887e02873bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:43.676486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524001d-e0c3-48bd-83b5-8887e02873bd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.676778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524001d-e0c3-48bd-83b5-8887e02873bd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.677058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524001d-e0c3-48bd-83b5-8887e02873bd None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.677815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524001d-e0c3-48bd-83b5-8887e02873bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:43.678126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524001d-e0c3-48bd-83b5-8887e02873bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:43.678934 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9732761-c5e2-443b-967b-c6fc8ab5d37d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:43.679563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524001d-e0c3-48bd-83b5-8887e02873bd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:43.680489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9732761-c5e2-443b-967b-c6fc8ab5d37d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:43.691708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:57:43.697308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524001d-e0c3-48bd-83b5-8887e02873bd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:43.778910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 21:57:43.784520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9732761-c5e2-443b-967b-c6fc8ab5d37d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:43.787994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:43.799981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524001d-e0c3-48bd-83b5-8887e02873bd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:43.834721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af594b76-c112-4b93-8b2f-5e5fda6db0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:43.837018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af594b76-c112-4b93-8b2f-5e5fda6db0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.837315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af594b76-c112-4b93-8b2f-5e5fda6db0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.837594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af594b76-c112-4b93-8b2f-5e5fda6db0a1 None admin] PATH_INFO: `/v3/users/9a1c8175bf58440a96c9e02fcf618584` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.838831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af594b76-c112-4b93-8b2f-5e5fda6db0a1 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1c8175bf58440a96c9e02fcf618584)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:43.840347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af594b76-c112-4b93-8b2f-5e5fda6db0a1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:43.842170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:57:43 2022] GET /identity/v3/users/9a1c8175bf58440a96c9e02fcf618584 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:57:43.847331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af594b76-c112-4b93-8b2f-5e5fda6db0a1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:43.863799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:43.890725 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9732761-c5e2-443b-967b-c6fc8ab5d37d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:43.924734 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2212c-9965-47d9-9fc3-5cc91ee4afaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:43.925524 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2212c-9965-47d9-9fc3-5cc91ee4afaa None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.925813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2212c-9965-47d9-9fc3-5cc91ee4afaa None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.926093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2212c-9965-47d9-9fc3-5cc91ee4afaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.944801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2212c-9965-47d9-9fc3-5cc91ee4afaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:43.946981 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2212c-9965-47d9-9fc3-5cc91ee4afaa None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:43.949230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af594b76-c112-4b93-8b2f-5e5fda6db0a1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-3bf2212c-9965-47d9-9fc3-5cc91ee4afaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:57:43.967814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:57:43.968699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:57:43.969490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:57:43.969490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:57:43.969490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:57:43.969490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:57:43.969490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:57:43.975579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2212c-9965-47d9-9fc3-5cc91ee4afaa None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:43.983450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0893f2-ca74-4f4e-8776-1e495011179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:43.984287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0893f2-ca74-4f4e-8776-1e495011179f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:43.984573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0893f2-ca74-4f4e-8776-1e495011179f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:43.984853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0893f2-ca74-4f4e-8776-1e495011179f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:43.986062 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0893f2-ca74-4f4e-8776-1e495011179f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:43.987495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0893f2-ca74-4f4e-8776-1e495011179f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:43.989119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:43.994821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0893f2-ca74-4f4e-8776-1e495011179f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:44.031497 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:44.072955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:44.074593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2212c-9965-47d9-9fc3-5cc91ee4afaa None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:44.094184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0893f2-ca74-4f4e-8776-1e495011179f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:44.109453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaa4a7-0caa-413e-b735-6b15b61e3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:44.110146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaa4a7-0caa-413e-b735-6b15b61e3324 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:44.110433 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaa4a7-0caa-413e-b735-6b15b61e3324 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:44.110711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaa4a7-0caa-413e-b735-6b15b61e3324 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:44.111472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efaa4a7-0caa-413e-b735-6b15b61e3324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:44.111782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efaa4a7-0caa-413e-b735-6b15b61e3324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:44.113197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efaa4a7-0caa-413e-b735-6b15b61e3324 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:44.128468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6f5b5-8f32-4a22-b2bb-a4961f8facb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:44.129138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6f5b5-8f32-4a22-b2bb-a4961f8facb3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:44.129428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6f5b5-8f32-4a22-b2bb-a4961f8facb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:44.129707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6f5b5-8f32-4a22-b2bb-a4961f8facb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:44.130542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6f5b5-8f32-4a22-b2bb-a4961f8facb3 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.domain.id=default, user.id=9a1c8175bf58440a96c9e02fcf618584) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:44.130859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6f5b5-8f32-4a22-b2bb-a4961f8facb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:44.133259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6f5b5-8f32-4a22-b2bb-a4961f8facb3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:44.137237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 10/20] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:57:44.140826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 11/21] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Jul 13 21:57:43 2022] GET /identity/v3/role_assignments?user.id=9a1c8175bf58440a96c9e02fcf618584&scope.domain.id=default&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:46.666697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d0a5-e3d4-44b2-9f06-68c95bea6e1c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:46.667200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d0a5-e3d4-44b2-9f06-68c95bea6e1c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:46.667375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d0a5-e3d4-44b2-9f06-68c95bea6e1c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:46.668669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 11/22] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:46.674120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248236f7-7397-48ae-8386-cf700e9ac4f1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:46.674531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248236f7-7397-48ae-8386-cf700e9ac4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:46.674683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248236f7-7397-48ae-8386-cf700e9ac4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:46.701087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-248236f7-7397-48ae-8386-cf700e9ac4f1 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:46.702630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-248236f7-7397-48ae-8386-cf700e9ac4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:46.790280 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:57:46.825457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d0a5-e3d4-44b2-9f06-68c95bea6e1c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:46.875928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d4415-2e07-482a-82ca-71ea263a78b7 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:46.876595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d4415-2e07-482a-82ca-71ea263a78b7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:46.877077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d4415-2e07-482a-82ca-71ea263a78b7 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:46.878681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:57:46.889340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31df165-e68b-4537-a448-f6839ea044d4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:46.890046 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31df165-e68b-4537-a448-f6839ea044d4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:46.890562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31df165-e68b-4537-a448-f6839ea044d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:46.918044 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b31df165-e68b-4537-a448-f6839ea044d4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:46.919727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b31df165-e68b-4537-a448-f6839ea044d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:46.981565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d0a5-e3d4-44b2-9f06-68c95bea6e1c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:47.006197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:47.041537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c3548-9d27-4096-bb21-f432ede04f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:47.042346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3548-9d27-4096-bb21-f432ede04f72 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.042631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3548-9d27-4096-bb21-f432ede04f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.042908 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3548-9d27-4096-bb21-f432ede04f72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.050384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 14/25] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:57:47.065129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c3548-9d27-4096-bb21-f432ede04f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:57:47.077206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef594-c98e-4b76-843f-8ee43686675b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.077505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef594-c98e-4b76-843f-8ee43686675b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.077789 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef594-c98e-4b76-843f-8ee43686675b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-df7c3548-9d27-4096-bb21-f432ede04f72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:57:47.078241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:57:47.079047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:57:47.079787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:57:47.080381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 15/26] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:57:47.081016 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 12/27] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:57:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:57:47.085497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef594-c98e-4b76-843f-8ee43686675b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:47.086836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918278f0-d7d4-4701-847a-45c8fd789408 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.087129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918278f0-d7d4-4701-847a-45c8fd789408 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.087412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918278f0-d7d4-4701-847a-45c8fd789408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.100520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:47.123926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-918278f0-d7d4-4701-847a-45c8fd789408 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:47.123926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-918278f0-d7d4-4701-847a-45c8fd789408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:47.247660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 13/28] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:57:47.248345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918278f0-d7d4-4701-847a-45c8fd789408 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:47.256420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef594-c98e-4b76-843f-8ee43686675b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:47.313591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7759fd-6b6e-40a2-aedd-4666ce9e4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:47.314276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7759fd-6b6e-40a2-aedd-4666ce9e4692 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.314566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7759fd-6b6e-40a2-aedd-4666ce9e4692 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.314845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7759fd-6b6e-40a2-aedd-4666ce9e4692 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.315608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7759fd-6b6e-40a2-aedd-4666ce9e4692 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:47.315933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7759fd-6b6e-40a2-aedd-4666ce9e4692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:47.317340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7759fd-6b6e-40a2-aedd-4666ce9e4692 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:47.326833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 16/29] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:57:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:47.327995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7759fd-6b6e-40a2-aedd-4666ce9e4692 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:47.374384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918278f0-d7d4-4701-847a-45c8fd789408 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:47.382163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:47.399313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:47.412337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85379ce-42f5-438b-b1ac-fb3b7b5cb5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:47.413394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85379ce-42f5-438b-b1ac-fb3b7b5cb5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.413853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85379ce-42f5-438b-b1ac-fb3b7b5cb5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.414269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85379ce-42f5-438b-b1ac-fb3b7b5cb5f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.425228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85379ce-42f5-438b-b1ac-fb3b7b5cb5f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:47.426867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85379ce-42f5-438b-b1ac-fb3b7b5cb5f9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:47.437389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7759fd-6b6e-40a2-aedd-4666ce9e4692 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c85379ce-42f5-438b-b1ac-fb3b7b5cb5f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:57:47.445892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:57:47.446844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:57:47.447733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:57:47.447733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:57:47.447733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:57:47.447733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:57:47.449234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 14/30] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:57:47.450136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85379ce-42f5-438b-b1ac-fb3b7b5cb5f9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:47.479016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd911c-49b0-4f1b-8329-8bca40807067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:47.479684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd911c-49b0-4f1b-8329-8bca40807067 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.480161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd911c-49b0-4f1b-8329-8bca40807067 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.480606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd911c-49b0-4f1b-8329-8bca40807067 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.481496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd911c-49b0-4f1b-8329-8bca40807067 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:47.483042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd911c-49b0-4f1b-8329-8bca40807067 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:47.555939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85379ce-42f5-438b-b1ac-fb3b7b5cb5f9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:47.591831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b205-4411-4dd4-931a-6e5490b10ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:47.593010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b205-4411-4dd4-931a-6e5490b10ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.593435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b205-4411-4dd4-931a-6e5490b10ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.593853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b205-4411-4dd4-931a-6e5490b10ee9 None admin] PATH_INFO: `/v3/users/9a1c8175bf58440a96c9e02fcf618584` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.601030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4b205-4411-4dd4-931a-6e5490b10ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1c8175bf58440a96c9e02fcf618584)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:47.603268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4b205-4411-4dd4-931a-6e5490b10ee9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:47.605126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 15/31] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:57:47 2022] GET /identity/v3/users/9a1c8175bf58440a96c9e02fcf618584 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:47.616084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b205-4411-4dd4-931a-6e5490b10ee9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:47.671639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:47.683958 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 17/32] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 21:57:47 2022] POST /identity/v3/roles => generated 225 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:57:47.685824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd911c-49b0-4f1b-8329-8bca40807067 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:47.858078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b205-4411-4dd4-931a-6e5490b10ee9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:47.862056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd911c-49b0-4f1b-8329-8bca40807067 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:47.896279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:47.913388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98c981-741e-4ad6-9ab6-aff64a18ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:47.914787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98c981-741e-4ad6-9ab6-aff64a18ee94 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.915314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98c981-741e-4ad6-9ab6-aff64a18ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.915799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98c981-741e-4ad6-9ab6-aff64a18ee94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.917623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98c981-741e-4ad6-9ab6-aff64a18ee94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:47.919519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98c981-741e-4ad6-9ab6-aff64a18ee94 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:47.921535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 18/33] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:47.924759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b19a19-948a-4a38-94e9-a8f0df5db527 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.926196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b19a19-948a-4a38-94e9-a8f0df5db527 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.927309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b19a19-948a-4a38-94e9-a8f0df5db527 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.930386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 19/34] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:47.931787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b19a19-948a-4a38-94e9-a8f0df5db527 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:47.936585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332eadbf-4431-49cc-a634-39dc2543dc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:47.937558 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eadbf-4431-49cc-a634-39dc2543dc58 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.938049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eadbf-4431-49cc-a634-39dc2543dc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.938592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eadbf-4431-49cc-a634-39dc2543dc58 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.940974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332eadbf-4431-49cc-a634-39dc2543dc58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:47.941571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332eadbf-4431-49cc-a634-39dc2543dc58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:47.943210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332eadbf-4431-49cc-a634-39dc2543dc58 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:47.962935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 16/35] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:47.964379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f75a-d194-4911-aaa0-1e1ab4821384 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:47.964673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f75a-d194-4911-aaa0-1e1ab4821384 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:47.965007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f75a-d194-4911-aaa0-1e1ab4821384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:47.983403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4294f75a-d194-4911-aaa0-1e1ab4821384 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:47.986861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4294f75a-d194-4911-aaa0-1e1ab4821384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:48.069532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 17/36] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:57:48.071011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532673-975a-4b9b-b5d6-c12d309ce998 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.071398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532673-975a-4b9b-b5d6-c12d309ce998 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.071690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532673-975a-4b9b-b5d6-c12d309ce998 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.076064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 18/37] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:48.077098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35532673-975a-4b9b-b5d6-c12d309ce998 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:48.079647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b19a19-948a-4a38-94e9-a8f0df5db527 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:48.106331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:48.119021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d13a9-605d-40ef-8598-3618e31f3f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:48.119961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d13a9-605d-40ef-8598-3618e31f3f81 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.120226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d13a9-605d-40ef-8598-3618e31f3f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.120518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d13a9-605d-40ef-8598-3618e31f3f81 None admin] PATH_INFO: `/v3/domains/default/users/9a1c8175bf58440a96c9e02fcf618584/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.122659 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d13a9-605d-40ef-8598-3618e31f3f81 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9a1c8175bf58440a96c9e02fcf618584, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:48.124143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d13a9-605d-40ef-8598-3618e31f3f81 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:48.147933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 20/38] 10.222.0.17 () {58 vars in 1361 bytes} [Wed Jul 13 21:57:47 2022] PUT /identity/v3/domains/default/users/9a1c8175bf58440a96c9e02fcf618584/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:57:48.147933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa051787-3df4-40e5-91e2-48948d9ec8e3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.147933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa051787-3df4-40e5-91e2-48948d9ec8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.147933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa051787-3df4-40e5-91e2-48948d9ec8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.171881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-aa051787-3df4-40e5-91e2-48948d9ec8e3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:48.174903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-aa051787-3df4-40e5-91e2-48948d9ec8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:48.213090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35532673-975a-4b9b-b5d6-c12d309ce998 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:48.251892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:48.253187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d38d31-da3d-4323-99ca-3c564bdd0bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:48.254103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d38d31-da3d-4323-99ca-3c564bdd0bf9 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.254586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d38d31-da3d-4323-99ca-3c564bdd0bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.255069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d38d31-da3d-4323-99ca-3c564bdd0bf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.255987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d38d31-da3d-4323-99ca-3c564bdd0bf9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:48.258203 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d38d31-da3d-4323-99ca-3c564bdd0bf9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:48.283297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 21/39] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:57:48.284748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa051787-3df4-40e5-91e2-48948d9ec8e3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:48.424363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 19/40] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:57:48 2022] POST /identity/v3/projects => generated 301 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:57:48.426225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15872-e592-4253-ab57-1a29dfe35c93 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.426672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15872-e592-4253-ab57-1a29dfe35c93 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.427120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15872-e592-4253-ab57-1a29dfe35c93 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.428756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 20/41] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:48.429746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d15872-e592-4253-ab57-1a29dfe35c93 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:48.517243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa051787-3df4-40e5-91e2-48948d9ec8e3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:48.525929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:48.560722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ad3af-fabe-4939-afc2-a6891e857fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:48.561756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ad3af-fabe-4939-afc2-a6891e857fa8 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.562275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ad3af-fabe-4939-afc2-a6891e857fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.562836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ad3af-fabe-4939-afc2-a6891e857fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.563788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ad3af-fabe-4939-afc2-a6891e857fa8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:48.565645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ad3af-fabe-4939-afc2-a6891e857fa8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:48.574774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d15872-e592-4253-ab57-1a29dfe35c93 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:48.590302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 21:57:48 2022] POST /identity/v3/roles => generated 219 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:57:48.591879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac90d6b-f7b6-44dc-a2b8-6b5760c8ea2b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.592399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac90d6b-f7b6-44dc-a2b8-6b5760c8ea2b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.592836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac90d6b-f7b6-44dc-a2b8-6b5760c8ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.615876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-dac90d6b-f7b6-44dc-a2b8-6b5760c8ea2b None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:48.619270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dac90d6b-f7b6-44dc-a2b8-6b5760c8ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:48.628577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e9147-6415-4d61-9075-74cf9e62ce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:48.629406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e9147-6415-4d61-9075-74cf9e62ce93 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.629693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e9147-6415-4d61-9075-74cf9e62ce93 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.629975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e9147-6415-4d61-9075-74cf9e62ce93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.631393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e9147-6415-4d61-9075-74cf9e62ce93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:48.634210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e9147-6415-4d61-9075-74cf9e62ce93 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:48.637094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:57:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:48.644444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e9147-6415-4d61-9075-74cf9e62ce93 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:48.686731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:48.734400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 23/44] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:57:48.762713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac90d6b-f7b6-44dc-a2b8-6b5760c8ea2b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:48.789284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e9147-6415-4d61-9075-74cf9e62ce93 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:48.838690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d2e7b-b55c-4b16-9a46-cedf57198282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:48.839466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d2e7b-b55c-4b16-9a46-cedf57198282 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.839757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d2e7b-b55c-4b16-9a46-cedf57198282 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.840084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d2e7b-b55c-4b16-9a46-cedf57198282 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.840810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d2e7b-b55c-4b16-9a46-cedf57198282 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:48.842393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d2e7b-b55c-4b16-9a46-cedf57198282 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:48.847604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:48.896959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac90d6b-f7b6-44dc-a2b8-6b5760c8ea2b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:48.935144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73137802-b254-427d-a836-a1971756625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:48.935848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73137802-b254-427d-a836-a1971756625a None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:48.936170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73137802-b254-427d-a836-a1971756625a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:48.936453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73137802-b254-427d-a836-a1971756625a None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:48.937292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73137802-b254-427d-a836-a1971756625a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:48.938675 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73137802-b254-427d-a836-a1971756625a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:48.964018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 24/45] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 21:57:48 2022] POST /identity/v3/roles => generated 223 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 21:57:48.986442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 22/46] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:57:48 2022] POST /identity/v3/projects => generated 312 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:57:50.265846 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55822bd-530c-45f6-b447-54732a238502 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:50.266379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55822bd-530c-45f6-b447-54732a238502 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:50.266462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55822bd-530c-45f6-b447-54732a238502 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:50.267771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 25/47] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:50.273337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9950-81b2-414b-bbc4-abab76116a56 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:50.273756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9950-81b2-414b-bbc4-abab76116a56 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:50.273906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9950-81b2-414b-bbc4-abab76116a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:50.290280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d00c9950-81b2-414b-bbc4-abab76116a56 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:50.291789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d00c9950-81b2-414b-bbc4-abab76116a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:50.356259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 23/48] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:57:50.379292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55822bd-530c-45f6-b447-54732a238502 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:50.415511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:50.482054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55822bd-530c-45f6-b447-54732a238502 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:50.515710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7d652-9653-4d90-9a02-0cdbf60e4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:50.516529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d652-9653-4d90-9a02-0cdbf60e4c07 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:50.516818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d652-9653-4d90-9a02-0cdbf60e4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:50.517096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d652-9653-4d90-9a02-0cdbf60e4c07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:50.527356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7d652-9653-4d90-9a02-0cdbf60e4c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c4a7d652-9653-4d90-9a02-0cdbf60e4c07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:57:50.537233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:57:50.538293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:57:50.539636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:57:50.540549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 26/49] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:57:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:57:50.545463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c9950-81b2-414b-bbc4-abab76116a56 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:50.642712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c9950-81b2-414b-bbc4-abab76116a56 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:50.659065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:50.676485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126aef3-85ac-4e00-85a7-78a7e6e2b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:50.677159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126aef3-85ac-4e00-85a7-78a7e6e2b407 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:50.677446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126aef3-85ac-4e00-85a7-78a7e6e2b407 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:50.677725 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126aef3-85ac-4e00-85a7-78a7e6e2b407 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:50.678482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126aef3-85ac-4e00-85a7-78a7e6e2b407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:50.678792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126aef3-85ac-4e00-85a7-78a7e6e2b407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:50.680954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126aef3-85ac-4e00-85a7-78a7e6e2b407 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:50.692681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 24/50] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:57:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:57:50.698512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7d652-9653-4d90-9a02-0cdbf60e4c07 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:50.792288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:50.799563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7d652-9653-4d90-9a02-0cdbf60e4c07 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:50.833217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e821e2-65cd-41cb-b84d-b523c7ed293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:50.834100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e821e2-65cd-41cb-b84d-b523c7ed293a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:50.834392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e821e2-65cd-41cb-b84d-b523c7ed293a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:50.834930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e821e2-65cd-41cb-b84d-b523c7ed293a None admin] PATH_INFO: `/v3/users/9a1c8175bf58440a96c9e02fcf618584` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:50.836677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e821e2-65cd-41cb-b84d-b523c7ed293a None admin] RBAC: Authorizing `identity:get_user(user_id=9a1c8175bf58440a96c9e02fcf618584)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:50.838152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e821e2-65cd-41cb-b84d-b523c7ed293a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:50.839800 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 27/51] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:57:50 2022] GET /identity/v3/users/9a1c8175bf58440a96c9e02fcf618584 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:50.845226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126aef3-85ac-4e00-85a7-78a7e6e2b407 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:50.940913 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126aef3-85ac-4e00-85a7-78a7e6e2b407 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:50.973564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb6bc-dcb1-4ee3-b9eb-021c1e75604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:50.974359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb6bc-dcb1-4ee3-b9eb-021c1e75604f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:50.974647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb6bc-dcb1-4ee3-b9eb-021c1e75604f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:50.974927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb6bc-dcb1-4ee3-b9eb-021c1e75604f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:50.976782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb6bc-dcb1-4ee3-b9eb-021c1e75604f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:50.978371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb6bc-dcb1-4ee3-b9eb-021c1e75604f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:50.980010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 25/52] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:50.985695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e821e2-65cd-41cb-b84d-b523c7ed293a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:51.082325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e821e2-65cd-41cb-b84d-b523c7ed293a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:51.087857 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a18a1-8c6d-4481-8701-27c9c6e83a41 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:51.088192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a18a1-8c6d-4481-8701-27c9c6e83a41 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:51.088477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a18a1-8c6d-4481-8701-27c9c6e83a41 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:51.089860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 26/53] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:57:51.094707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e529208-62c0-4922-95de-085bc22c08ef None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:51.095063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e529208-62c0-4922-95de-085bc22c08ef None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:51.095353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e529208-62c0-4922-95de-085bc22c08ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:51.113924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6e529208-62c0-4922-95de-085bc22c08ef None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:51.115129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6e529208-62c0-4922-95de-085bc22c08ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:51.118131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e204b3-9d1e-4632-affb-a498b7888c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:51.118803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e204b3-9d1e-4632-affb-a498b7888c4e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:51.119096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e204b3-9d1e-4632-affb-a498b7888c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:51.119381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e204b3-9d1e-4632-affb-a498b7888c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:51.120259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e204b3-9d1e-4632-affb-a498b7888c4e None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.domain.id=default, user.id=9a1c8175bf58440a96c9e02fcf618584) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:51.120577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e204b3-9d1e-4632-affb-a498b7888c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:51.122038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e204b3-9d1e-4632-affb-a498b7888c4e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:51.128447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 28/54] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Jul 13 21:57:50 2022] GET /identity/v3/role_assignments?user.id=9a1c8175bf58440a96c9e02fcf618584&scope.domain.id=default&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:51.165099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:51.189256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 27/55] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:57:51.213582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e204b3-9d1e-4632-affb-a498b7888c4e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:51.242468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:51.318256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e204b3-9d1e-4632-affb-a498b7888c4e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:51.352187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f462b54-feb6-494c-9238-a5e242f6f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:51.352983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f462b54-feb6-494c-9238-a5e242f6f0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:51.353270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f462b54-feb6-494c-9238-a5e242f6f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:51.353549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f462b54-feb6-494c-9238-a5e242f6f0e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:51.354710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f462b54-feb6-494c-9238-a5e242f6f0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:51.356179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f462b54-feb6-494c-9238-a5e242f6f0e1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:51.357794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 29/56] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:57:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:51.363468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e529208-62c0-4922-95de-085bc22c08ef None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:51.463459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e529208-62c0-4922-95de-085bc22c08ef None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:51.499448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381630-a865-402f-9db5-b6982da5d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:51.500138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381630-a865-402f-9db5-b6982da5d12c None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:51.500430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381630-a865-402f-9db5-b6982da5d12c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:51.500721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381630-a865-402f-9db5-b6982da5d12c None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:51.501429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381630-a865-402f-9db5-b6982da5d12c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:51.502862 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381630-a865-402f-9db5-b6982da5d12c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:51.528593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 28/57] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Jul 13 21:57:51 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:57:53.547184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c22c6-9a24-45b9-8693-05bfe4da383d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:53.547726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c22c6-9a24-45b9-8693-05bfe4da383d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:53.547835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c22c6-9a24-45b9-8693-05bfe4da383d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:53.549174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 30/58] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:53.554323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb1a6-ce12-45be-9660-f83de44fcaa7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:53.554895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb1a6-ce12-45be-9660-f83de44fcaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:53.554895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb1a6-ce12-45be-9660-f83de44fcaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:53.571638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b8ecb1a6-ce12-45be-9660-f83de44fcaa7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:53.572854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b8ecb1a6-ce12-45be-9660-f83de44fcaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:53.596044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:53.638486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 29/59] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:57:53.662982 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c22c6-9a24-45b9-8693-05bfe4da383d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:53.759423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:53.767169 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c22c6-9a24-45b9-8693-05bfe4da383d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:53.800190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158446a-581f-4341-bcab-587bfc055c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:53.800923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158446a-581f-4341-bcab-587bfc055c63 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:53.801212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158446a-581f-4341-bcab-587bfc055c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:53.801495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158446a-581f-4341-bcab-587bfc055c63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:53.802667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158446a-581f-4341-bcab-587bfc055c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:53.804256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158446a-581f-4341-bcab-587bfc055c63 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:53.805874 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 31/60] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:57:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:53.811538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecb1a6-ce12-45be-9660-f83de44fcaa7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:53.906274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecb1a6-ce12-45be-9660-f83de44fcaa7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:53.940080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390e3e8-896b-41f4-956e-9323e2d8bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:53.940752 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390e3e8-896b-41f4-956e-9323e2d8bbe9 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:53.941041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390e3e8-896b-41f4-956e-9323e2d8bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:53.941322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390e3e8-896b-41f4-956e-9323e2d8bbe9 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:53.942037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390e3e8-896b-41f4-956e-9323e2d8bbe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:53.943473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390e3e8-896b-41f4-956e-9323e2d8bbe9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:53.968889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 30/61] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:57:53 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 21:57:57.224158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625080d6-240b-482a-871b-09e5cc450400 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.225170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625080d6-240b-482a-871b-09e5cc450400 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.225733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625080d6-240b-482a-871b-09e5cc450400 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.227530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 32/62] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:57.229016 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761130dd-531b-49e3-a583-25c004a5a8aa None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.229416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761130dd-531b-49e3-a583-25c004a5a8aa None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.229601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761130dd-531b-49e3-a583-25c004a5a8aa None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.231314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:57:57.232571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72959a-aeb7-49a7-973a-71309233e580 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.232866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72959a-aeb7-49a7-973a-71309233e580 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.233150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72959a-aeb7-49a7-973a-71309233e580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.237708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8819550-6c8d-40f1-a799-2078a26b4ca8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.238357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8819550-6c8d-40f1-a799-2078a26b4ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.238847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8819550-6c8d-40f1-a799-2078a26b4ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.262665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3e72959a-aeb7-49a7-973a-71309233e580 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:57.267301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3e72959a-aeb7-49a7-973a-71309233e580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:57.268885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b8819550-6c8d-40f1-a799-2078a26b4ca8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:57.271823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b8819550-6c8d-40f1-a799-2078a26b4ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:57.285954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:57.350293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 33/64] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:57:57.352442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2a7f-b8f5-4952-b671-1ceb9bc9a9db None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.352952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2a7f-b8f5-4952-b671-1ceb9bc9a9db None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.353374 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2a7f-b8f5-4952-b671-1ceb9bc9a9db None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.354884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 34/65] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:57.360603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df6c06-177f-4487-97b0-39e39297c4c9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.361057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df6c06-177f-4487-97b0-39e39297c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.361492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df6c06-177f-4487-97b0-39e39297c4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.362004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 32/66] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:57:57.386728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8819550-6c8d-40f1-a799-2078a26b4ca8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:57.392713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-98df6c06-177f-4487-97b0-39e39297c4c9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:57.393945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-98df6c06-177f-4487-97b0-39e39297c4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:57.469609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 35/67] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:57:57.470861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df6c06-177f-4487-97b0-39e39297c4c9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:57.496911 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:57.504957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8819550-6c8d-40f1-a799-2078a26b4ca8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:57.544256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87231217-bbc2-426d-b303-d25a9b58be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:57.545302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87231217-bbc2-426d-b303-d25a9b58be24 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.545766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87231217-bbc2-426d-b303-d25a9b58be24 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.546192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87231217-bbc2-426d-b303-d25a9b58be24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.558177 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87231217-bbc2-426d-b303-d25a9b58be24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-87231217-bbc2-426d-b303-d25a9b58be24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:57:57.566179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:57:57.567044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:57:57.567801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:57:57.571532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 33/68] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:57:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:57:57.572608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87231217-bbc2-426d-b303-d25a9b58be24 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:57.587489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:57.590194 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df6c06-177f-4487-97b0-39e39297c4c9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:57.628689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f490-5916-4727-babd-eb26c109a3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:57.629829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f490-5916-4727-babd-eb26c109a3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.630326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f490-5916-4727-babd-eb26c109a3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.630838 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f490-5916-4727-babd-eb26c109a3a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.645139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5f490-5916-4727-babd-eb26c109a3a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-81b5f490-5916-4727-babd-eb26c109a3a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:57:57.654603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:57:57.655487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:57:57.656261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:57:57.658579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 36/69] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:57:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:57:57.659640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f490-5916-4727-babd-eb26c109a3a3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:57.697650 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87231217-bbc2-426d-b303-d25a9b58be24 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:57.735267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d4dcf-c908-400b-93d4-56a4f7ea6a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:57.736135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d4dcf-c908-400b-93d4-56a4f7ea6a91 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.736591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d4dcf-c908-400b-93d4-56a4f7ea6a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.737047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d4dcf-c908-400b-93d4-56a4f7ea6a91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.748849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d4dcf-c908-400b-93d4-56a4f7ea6a91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:57:57.754031 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-057d4dcf-c908-400b-93d4-56a4f7ea6a91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:57:57.756682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:57:57.757657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:57:57.758395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 34/70] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:57:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:57:57.759010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d4dcf-c908-400b-93d4-56a4f7ea6a91 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:57.783440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f490-5916-4727-babd-eb26c109a3a3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:57.819119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a3afe-0c25-436c-b60e-0dcce4380edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:57.820423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a3afe-0c25-436c-b60e-0dcce4380edf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.820712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a3afe-0c25-436c-b60e-0dcce4380edf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.820993 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a3afe-0c25-436c-b60e-0dcce4380edf None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.821745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a3afe-0c25-436c-b60e-0dcce4380edf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:57.822051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a3afe-0c25-436c-b60e-0dcce4380edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:57.823445 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a3afe-0c25-436c-b60e-0dcce4380edf None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:57.829233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:57.831571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 37/71] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:57:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:57.832821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01adc9a-22a9-42a8-b655-bb30a612f632 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.833114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01adc9a-22a9-42a8-b655-bb30a612f632 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.833394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01adc9a-22a9-42a8-b655-bb30a612f632 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 38/72] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:57.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01adc9a-22a9-42a8-b655-bb30a612f632 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:57.868468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d4dcf-c908-400b-93d4-56a4f7ea6a91 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:57.902696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0782dd8-6d92-4518-b885-9210edde1b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:57.903305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782dd8-6d92-4518-b885-9210edde1b28 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.903592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782dd8-6d92-4518-b885-9210edde1b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.903879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782dd8-6d92-4518-b885-9210edde1b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.904669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0782dd8-6d92-4518-b885-9210edde1b28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:57.904983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0782dd8-6d92-4518-b885-9210edde1b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:57.906374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0782dd8-6d92-4518-b885-9210edde1b28 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:57.914259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 35/73] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:57:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:57.915485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41cf90-d309-4674-8967-535311dfc17f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.915785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41cf90-d309-4674-8967-535311dfc17f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.916102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41cf90-d309-4674-8967-535311dfc17f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.917357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 36/74] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:57:57.918061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41cf90-d309-4674-8967-535311dfc17f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:57.939133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01adc9a-22a9-42a8-b655-bb30a612f632 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:57.972775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266633c2-1955-4fab-9a79-32a7a00e31ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:57.973447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266633c2-1955-4fab-9a79-32a7a00e31ed None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.973744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266633c2-1955-4fab-9a79-32a7a00e31ed None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.974030 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266633c2-1955-4fab-9a79-32a7a00e31ed None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.974784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266633c2-1955-4fab-9a79-32a7a00e31ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:57.975098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266633c2-1955-4fab-9a79-32a7a00e31ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:57.977059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266633c2-1955-4fab-9a79-32a7a00e31ed None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:57.984967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 39/75] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:57:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:57.986142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff93f29-44c5-445e-be88-740682c25648 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:57.986433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff93f29-44c5-445e-be88-740682c25648 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:57.986720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff93f29-44c5-445e-be88-740682c25648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:57.997629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.003092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5ff93f29-44c5-445e-be88-740682c25648 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:58.004340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5ff93f29-44c5-445e-be88-740682c25648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:58.021794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41cf90-d309-4674-8967-535311dfc17f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:58.048327 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.059964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e034b-d6da-4327-9594-733680d15291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:58.060867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e034b-d6da-4327-9594-733680d15291 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.061160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e034b-d6da-4327-9594-733680d15291 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.061442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e034b-d6da-4327-9594-733680d15291 None admin] PATH_INFO: `/v3/users/9a1c8175bf58440a96c9e02fcf618584` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.062674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e034b-d6da-4327-9594-733680d15291 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1c8175bf58440a96c9e02fcf618584)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:58.064146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e034b-d6da-4327-9594-733680d15291 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:58.065832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 37/76] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:57:57 2022] GET /identity/v3/users/9a1c8175bf58440a96c9e02fcf618584 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:58.066597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e034b-d6da-4327-9594-733680d15291 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:58.076701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 40/77] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:57:58.078055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f5bb6-4704-48ba-8d7f-5af81650e29f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.078360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f5bb6-4704-48ba-8d7f-5af81650e29f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.078650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f5bb6-4704-48ba-8d7f-5af81650e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.095774 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-416f5bb6-4704-48ba-8d7f-5af81650e29f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:57:58.097018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-416f5bb6-4704-48ba-8d7f-5af81650e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:57:58.167278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 41/78] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:57:58.168098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f5bb6-4704-48ba-8d7f-5af81650e29f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:58.179720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e034b-d6da-4327-9594-733680d15291 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:58.215749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ba890-c5ad-4a03-95a0-fdf0977bd97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:58.216756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ba890-c5ad-4a03-95a0-fdf0977bd97c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.217053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ba890-c5ad-4a03-95a0-fdf0977bd97c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.217349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ba890-c5ad-4a03-95a0-fdf0977bd97c None admin] PATH_INFO: `/v3/users/70ffe2ec3c4e406796db401ddf73f909` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.232785 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.233272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ba890-c5ad-4a03-95a0-fdf0977bd97c None admin] RBAC: Authorizing `identity:get_user(user_id=70ffe2ec3c4e406796db401ddf73f909)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:58.234329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ba890-c5ad-4a03-95a0-fdf0977bd97c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:58.236499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 38/79] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:57:58 2022] GET /identity/v3/users/70ffe2ec3c4e406796db401ddf73f909 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:58.237285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ba890-c5ad-4a03-95a0-fdf0977bd97c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:58.274063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f5bb6-4704-48ba-8d7f-5af81650e29f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:58.293851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.307864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6a0ae-e7d0-42ff-8836-c7aca9ef930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:58.308770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a0ae-e7d0-42ff-8836-c7aca9ef930d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.309063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a0ae-e7d0-42ff-8836-c7aca9ef930d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.309343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a0ae-e7d0-42ff-8836-c7aca9ef930d None admin] PATH_INFO: `/v3/users/70ffe2ec3c4e406796db401ddf73f909` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.310546 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6a0ae-e7d0-42ff-8836-c7aca9ef930d None admin] RBAC: Authorizing `identity:get_user(user_id=70ffe2ec3c4e406796db401ddf73f909)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:58.312021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6a0ae-e7d0-42ff-8836-c7aca9ef930d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:58.313645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 42/80] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:57:58 2022] GET /identity/v3/users/70ffe2ec3c4e406796db401ddf73f909 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:58.314406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6a0ae-e7d0-42ff-8836-c7aca9ef930d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:58.341427 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ba890-c5ad-4a03-95a0-fdf0977bd97c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:58.374113 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767a8f1-b1a3-4594-a9bf-fadd60910a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:58.374765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767a8f1-b1a3-4594-a9bf-fadd60910a76 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.375054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767a8f1-b1a3-4594-a9bf-fadd60910a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.375344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767a8f1-b1a3-4594-a9bf-fadd60910a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.415421 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6a0ae-e7d0-42ff-8836-c7aca9ef930d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:58.443893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767a8f1-b1a3-4594-a9bf-fadd60910a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:58.445423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767a8f1-b1a3-4594-a9bf-fadd60910a76 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:58.449135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18044e11-b813-4aad-a763-c5df66bd3b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:58.449927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18044e11-b813-4aad-a763-c5df66bd3b5b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.450220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18044e11-b813-4aad-a763-c5df66bd3b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.450508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18044e11-b813-4aad-a763-c5df66bd3b5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.452396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.463404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18044e11-b813-4aad-a763-c5df66bd3b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-18044e11-b813-4aad-a763-c5df66bd3b5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:57:58.471191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:57:58.472087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:57:58.472833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 43/81] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:57:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:57:58.473456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18044e11-b813-4aad-a763-c5df66bd3b5b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:58.503817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.549202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 39/82] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:57:58.550044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767a8f1-b1a3-4594-a9bf-fadd60910a76 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:58.579701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18044e11-b813-4aad-a763-c5df66bd3b5b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:58.612999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f914971-32cc-419b-9689-d98e54140bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:58.613790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f914971-32cc-419b-9689-d98e54140bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.614081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f914971-32cc-419b-9689-d98e54140bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.614359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f914971-32cc-419b-9689-d98e54140bd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.615520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f914971-32cc-419b-9689-d98e54140bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:58.617699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f914971-32cc-419b-9689-d98e54140bd8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:58.623638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 44/83] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:57:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:58.623638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f914971-32cc-419b-9689-d98e54140bd8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:58.653855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767a8f1-b1a3-4594-a9bf-fadd60910a76 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:58.681941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.688604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0547e-01f3-4cfd-a1b4-1fa7bc293dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:58.689335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0547e-01f3-4cfd-a1b4-1fa7bc293dda None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.689625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0547e-01f3-4cfd-a1b4-1fa7bc293dda None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.689907 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0547e-01f3-4cfd-a1b4-1fa7bc293dda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.714033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.724110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f914971-32cc-419b-9689-d98e54140bd8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:58.758137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248384cb-5e82-4fcd-bd8b-1f1b404c6c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:58.758802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248384cb-5e82-4fcd-bd8b-1f1b404c6c9a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.759098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248384cb-5e82-4fcd-bd8b-1f1b404c6c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.759388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248384cb-5e82-4fcd-bd8b-1f1b404c6c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.759578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0547e-01f3-4cfd-a1b4-1fa7bc293dda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:58.760991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0547e-01f3-4cfd-a1b4-1fa7bc293dda None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:58.827829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248384cb-5e82-4fcd-bd8b-1f1b404c6c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:58.829323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248384cb-5e82-4fcd-bd8b-1f1b404c6c9a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:58.859917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 40/84] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:57:58.860763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0547e-01f3-4cfd-a1b4-1fa7bc293dda None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:58.890370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.917084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:58.930787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 45/85] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:57:58.931630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248384cb-5e82-4fcd-bd8b-1f1b404c6c9a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:58.963101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0547e-01f3-4cfd-a1b4-1fa7bc293dda None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:58.995922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b36367-7312-4c33-af6a-b1758f2b800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:58.996612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b36367-7312-4c33-af6a-b1758f2b800d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:58.996900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b36367-7312-4c33-af6a-b1758f2b800d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:58.997180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b36367-7312-4c33-af6a-b1758f2b800d None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:58.997952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b36367-7312-4c33-af6a-b1758f2b800d None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:58.998264 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b36367-7312-4c33-af6a-b1758f2b800d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:58.999750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b36367-7312-4c33-af6a-b1758f2b800d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:59.008102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 41/86] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:59.008862 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b36367-7312-4c33-af6a-b1758f2b800d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:59.033231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248384cb-5e82-4fcd-bd8b-1f1b404c6c9a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:59.065490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5f0c-6b5a-4ffd-a492-ef7b1a678a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:59.066348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5f0c-6b5a-4ffd-a492-ef7b1a678a1f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:59.066642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5f0c-6b5a-4ffd-a492-ef7b1a678a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:59.066923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5f0c-6b5a-4ffd-a492-ef7b1a678a1f None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:59.068160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb5f0c-6b5a-4ffd-a492-ef7b1a678a1f None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:59.070334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb5f0c-6b5a-4ffd-a492-ef7b1a678a1f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:59.071835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 46/87] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:57:58 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:59.072621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5f0c-6b5a-4ffd-a492-ef7b1a678a1f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:59.102271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:59.117611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b36367-7312-4c33-af6a-b1758f2b800d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:59.134720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:59.152374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a034e-caed-4d83-801b-214d5a64c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:59.153036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a034e-caed-4d83-801b-214d5a64c8d9 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:59.153322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a034e-caed-4d83-801b-214d5a64c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:59.153603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a034e-caed-4d83-801b-214d5a64c8d9 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:59.154324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a034e-caed-4d83-801b-214d5a64c8d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:59.155767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a034e-caed-4d83-801b-214d5a64c8d9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:59.173447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5f0c-6b5a-4ffd-a492-ef7b1a678a1f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:59.187928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 42/88] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:57:59 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:57:59.187928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a034e-caed-4d83-801b-214d5a64c8d9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:59.212264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1d4e1-3a7e-447b-ae07-5985b70c74f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:59.213211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1d4e1-3a7e-447b-ae07-5985b70c74f6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:59.213501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1d4e1-3a7e-447b-ae07-5985b70c74f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:59.213791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1d4e1-3a7e-447b-ae07-5985b70c74f6 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:59.215073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1d4e1-3a7e-447b-ae07-5985b70c74f6 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:59.216625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1d4e1-3a7e-447b-ae07-5985b70c74f6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:59.218583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 47/89] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:57:59 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:59.219212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1d4e1-3a7e-447b-ae07-5985b70c74f6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:59.301364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a034e-caed-4d83-801b-214d5a64c8d9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:59.329430 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:59.333890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1d4e1-3a7e-447b-ae07-5985b70c74f6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:59.344498 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465b6c-fb63-4f0c-8451-ff519d2697e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:59.347923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465b6c-fb63-4f0c-8451-ff519d2697e7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:59.347923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465b6c-fb63-4f0c-8451-ff519d2697e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:59.347923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465b6c-fb63-4f0c-8451-ff519d2697e7 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:59.347923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69465b6c-fb63-4f0c-8451-ff519d2697e7 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:59.348627 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69465b6c-fb63-4f0c-8451-ff519d2697e7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:59.350610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 43/90] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:57:59 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:59.351462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465b6c-fb63-4f0c-8451-ff519d2697e7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:59.375607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758634f-e463-4002-9a45-01e54b1aa202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:59.376835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758634f-e463-4002-9a45-01e54b1aa202 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:59.377206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758634f-e463-4002-9a45-01e54b1aa202 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:59.377492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758634f-e463-4002-9a45-01e54b1aa202 None admin] PATH_INFO: `/v3/users/70ffe2ec3c4e406796db401ddf73f909` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:59.378729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758634f-e463-4002-9a45-01e54b1aa202 None admin] RBAC: Authorizing `identity:get_user(user_id=70ffe2ec3c4e406796db401ddf73f909)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:59.380222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758634f-e463-4002-9a45-01e54b1aa202 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:59.382651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 48/91] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:57:59 2022] GET /identity/v3/users/70ffe2ec3c4e406796db401ddf73f909 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:59.383536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758634f-e463-4002-9a45-01e54b1aa202 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:59.396062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:59.487796 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465b6c-fb63-4f0c-8451-ff519d2697e7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:59.525503 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758634f-e463-4002-9a45-01e54b1aa202 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:59.534115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658eb2e-707c-48d0-bd3d-3791464cd727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:59.535554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658eb2e-707c-48d0-bd3d-3791464cd727 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:59.536099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658eb2e-707c-48d0-bd3d-3791464cd727 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:59.537013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658eb2e-707c-48d0-bd3d-3791464cd727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:59.538556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658eb2e-707c-48d0-bd3d-3791464cd727 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=18959bc99d074db3beb4a507e6e95b08, user.id=9a1c8175bf58440a96c9e02fcf618584) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:59.539081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658eb2e-707c-48d0-bd3d-3791464cd727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:59.541486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658eb2e-707c-48d0-bd3d-3791464cd727 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:59.553426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 44/92] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:57:59 2022] GET /identity/v3/role_assignments?user.id=9a1c8175bf58440a96c9e02fcf618584&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:59.555038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658eb2e-707c-48d0-bd3d-3791464cd727 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:59.562565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ac828-30c1-4eb4-9814-cb7bf8342aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:59.563245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ac828-30c1-4eb4-9814-cb7bf8342aaa None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:59.563539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ac828-30c1-4eb4-9814-cb7bf8342aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:59.563823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ac828-30c1-4eb4-9814-cb7bf8342aaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:59.564754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ac828-30c1-4eb4-9814-cb7bf8342aaa None admin] RBAC: Adding query filter params (role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=18959bc99d074db3beb4a507e6e95b08, user.id=70ffe2ec3c4e406796db401ddf73f909) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:59.565075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ac828-30c1-4eb4-9814-cb7bf8342aaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:59.566570 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ac828-30c1-4eb4-9814-cb7bf8342aaa None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:59.576422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 49/93] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:57:59 2022] GET /identity/v3/role_assignments?user.id=70ffe2ec3c4e406796db401ddf73f909&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:59.577651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ac828-30c1-4eb4-9814-cb7bf8342aaa None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:57:59.666110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:59.752257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658eb2e-707c-48d0-bd3d-3791464cd727 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:59.757652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:57:59.842324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb3dd-d4cf-4cbe-ae09-d2a5461c78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:59.844172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb3dd-d4cf-4cbe-ae09-d2a5461c78c6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:59.844172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb3dd-d4cf-4cbe-ae09-d2a5461c78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:59.844172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb3dd-d4cf-4cbe-ae09-d2a5461c78c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:57:59.844413 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cb3dd-d4cf-4cbe-ae09-d2a5461c78c6 None admin] RBAC: Adding query filter params (role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=18959bc99d074db3beb4a507e6e95b08, user.id=70ffe2ec3c4e406796db401ddf73f909) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:57:59.844686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cb3dd-d4cf-4cbe-ae09-d2a5461c78c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:57:59.846163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cb3dd-d4cf-4cbe-ae09-d2a5461c78c6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:57:59.857623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 45/94] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:57:59 2022] GET /identity/v3/role_assignments?user.id=70ffe2ec3c4e406796db401ddf73f909&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:57:59.859110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ac828-30c1-4eb4-9814-cb7bf8342aaa None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:57:59.922059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f138ec0-0333-4998-ae6f-d0735c6e7d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:57:59.922978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f138ec0-0333-4998-ae6f-d0735c6e7d67 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:57:59.923410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f138ec0-0333-4998-ae6f-d0735c6e7d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:57:59.923854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f138ec0-0333-4998-ae6f-d0735c6e7d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:00.013012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f138ec0-0333-4998-ae6f-d0735c6e7d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:00.014519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f138ec0-0333-4998-ae6f-d0735c6e7d67 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:00.055299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:00.153895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 50/95] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:00.161662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb3dd-d4cf-4cbe-ae09-d2a5461c78c6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:00.316003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb3dd-d4cf-4cbe-ae09-d2a5461c78c6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:00.365262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e833c0-a160-4f20-ae34-99202880b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:00.366192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e833c0-a160-4f20-ae34-99202880b62f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:00.366506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e833c0-a160-4f20-ae34-99202880b62f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:00.366843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e833c0-a160-4f20-ae34-99202880b62f None admin] PATH_INFO: `/v3/projects/4fbd430abf3a4d769a67d30287795510` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:00.368123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e833c0-a160-4f20-ae34-99202880b62f None admin] RBAC: Authorizing `identity:get_project(project_id=4fbd430abf3a4d769a67d30287795510)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:00.369588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e833c0-a160-4f20-ae34-99202880b62f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:00.371319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 46/96] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:00 2022] GET /identity/v3/projects/4fbd430abf3a4d769a67d30287795510 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:00.377209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f138ec0-0333-4998-ae6f-d0735c6e7d67 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:00.528515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f138ec0-0333-4998-ae6f-d0735c6e7d67 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:00.570666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:00.576419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba717d25-0269-4a43-b648-940ca6b562c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:00.577099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717d25-0269-4a43-b648-940ca6b562c4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:00.580268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717d25-0269-4a43-b648-940ca6b562c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:00.580564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717d25-0269-4a43-b648-940ca6b562c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:00.581428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba717d25-0269-4a43-b648-940ca6b562c4 None admin] RBAC: Adding query filter params (role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=4fbd430abf3a4d769a67d30287795510, user.id=70ffe2ec3c4e406796db401ddf73f909) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:00.581753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba717d25-0269-4a43-b648-940ca6b562c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:00.583222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba717d25-0269-4a43-b648-940ca6b562c4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:00.589234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 51/97] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:00 2022] GET /identity/v3/role_assignments?user.id=70ffe2ec3c4e406796db401ddf73f909&scope.project.id=4fbd430abf3a4d769a67d30287795510&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:02.171155 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646c56-359d-47b8-9622-71a987f1cba1 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.172149 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646c56-359d-47b8-9622-71a987f1cba1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.172659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646c56-359d-47b8-9622-71a987f1cba1 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.174299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 47/98] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:02.180339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4124172-8e55-4c2b-b47c-6eca1b13762f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.181219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4124172-8e55-4c2b-b47c-6eca1b13762f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.181707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4124172-8e55-4c2b-b47c-6eca1b13762f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.202583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f4124172-8e55-4c2b-b47c-6eca1b13762f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:02.204152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f4124172-8e55-4c2b-b47c-6eca1b13762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:02.227572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d937a-a8f5-4b82-acec-5163af91f625 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.228245 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d937a-a8f5-4b82-acec-5163af91f625 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.228731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d937a-a8f5-4b82-acec-5163af91f625 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.230327 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 48/99] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:02.237888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797da8-48f0-4d78-ab47-406ff5fd38ed None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.238454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797da8-48f0-4d78-ab47-406ff5fd38ed None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.238957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797da8-48f0-4d78-ab47-406ff5fd38ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.261700 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5e797da8-48f0-4d78-ab47-406ff5fd38ed None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:02.264536 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5e797da8-48f0-4d78-ab47-406ff5fd38ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:02.316221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:02.326113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 52/100] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:02.330506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694fc3c-dc7e-400a-821d-5431b4dd5404 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.336856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694fc3c-dc7e-400a-821d-5431b4dd5404 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.337367 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694fc3c-dc7e-400a-821d-5431b4dd5404 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.338915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 53/101] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:02.344434 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca12e-1a25-4001-ab8a-dd2634c9fde9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.344987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca12e-1a25-4001-ab8a-dd2634c9fde9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.345469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca12e-1a25-4001-ab8a-dd2634c9fde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.370981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a51ca12e-1a25-4001-ab8a-dd2634c9fde9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:02.372388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a51ca12e-1a25-4001-ab8a-dd2634c9fde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:02.374874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 49/102] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:02.375985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797da8-48f0-4d78-ab47-406ff5fd38ed None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:02.477899 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797da8-48f0-4d78-ab47-406ff5fd38ed None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:02.513487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bd752-cb8e-4954-abc0-23e81eb88f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:02.514658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bd752-cb8e-4954-abc0-23e81eb88f35 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.515173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bd752-cb8e-4954-abc0-23e81eb88f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.515659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bd752-cb8e-4954-abc0-23e81eb88f35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.517084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bd752-cb8e-4954-abc0-23e81eb88f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:02.518744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bd752-cb8e-4954-abc0-23e81eb88f35 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:02.520649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 50/103] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:02.521626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bd752-cb8e-4954-abc0-23e81eb88f35 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:02.564822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:02.565899 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 54/104] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:02.566830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca12e-1a25-4001-ab8a-dd2634c9fde9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:02.643999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:02.652864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bd752-cb8e-4954-abc0-23e81eb88f35 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:02.695508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca12e-1a25-4001-ab8a-dd2634c9fde9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:02.700485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b9d4-7be7-409a-9024-ec66fe5d1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:02.701312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b9d4-7be7-409a-9024-ec66fe5d1dca None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.701599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b9d4-7be7-409a-9024-ec66fe5d1dca None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.701882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b9d4-7be7-409a-9024-ec66fe5d1dca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.716360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052b9d4-7be7-409a-9024-ec66fe5d1dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-5052b9d4-7be7-409a-9024-ec66fe5d1dca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:02.727937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:02.728808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:02.729588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 51/105] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:02.730429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa49cf-cec8-406a-806a-09c44ddfb7f7 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.730866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa49cf-cec8-406a-806a-09c44ddfb7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.731562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa49cf-cec8-406a-806a-09c44ddfb7f7 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.733865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 52/106] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:02.734718 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa49cf-cec8-406a-806a-09c44ddfb7f7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:02.742331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418d278-109e-47b1-b2db-805341752f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:02.743135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418d278-109e-47b1-b2db-805341752f40 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.743548 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418d278-109e-47b1-b2db-805341752f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.743920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418d278-109e-47b1-b2db-805341752f40 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.744833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418d278-109e-47b1-b2db-805341752f40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:02.746587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418d278-109e-47b1-b2db-805341752f40 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:02.782602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 55/107] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:58:02 2022] POST /identity/v3/projects => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:02.783775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418d278-109e-47b1-b2db-805341752f40 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:02.905213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:02.918614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa49cf-cec8-406a-806a-09c44ddfb7f7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:02.921574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418d278-109e-47b1-b2db-805341752f40 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:02.933926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:02.973967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b54385-45f4-4f19-9c35-5ba57ca34fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:02.974497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54385-45f4-4f19-9c35-5ba57ca34fdf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:02.974790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54385-45f4-4f19-9c35-5ba57ca34fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:02.975075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54385-45f4-4f19-9c35-5ba57ca34fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:02.975924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b54385-45f4-4f19-9c35-5ba57ca34fdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:02.977951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b54385-45f4-4f19-9c35-5ba57ca34fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:02.980291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b54385-45f4-4f19-9c35-5ba57ca34fdf None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:02.997751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2453aa-13bb-4cff-9156-a24c09e65ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.000053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2453aa-13bb-4cff-9156-a24c09e65ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.000348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2453aa-13bb-4cff-9156-a24c09e65ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.000637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2453aa-13bb-4cff-9156-a24c09e65ba6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.003150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 56/108] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:03.004788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d700e45-0415-4eed-913d-aa487b1241a3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.005082 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d700e45-0415-4eed-913d-aa487b1241a3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.005367 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d700e45-0415-4eed-913d-aa487b1241a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.031173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2453aa-13bb-4cff-9156-a24c09e65ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:03.042446 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7d700e45-0415-4eed-913d-aa487b1241a3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:03.043725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7d700e45-0415-4eed-913d-aa487b1241a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8d2453aa-13bb-4cff-9156-a24c09e65ba6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:03.044308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:03.045230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:03.045979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:03.048343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 53/109] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:03.049351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2453aa-13bb-4cff-9156-a24c09e65ba6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.141887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 57/110] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:03.143811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d700e45-0415-4eed-913d-aa487b1241a3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.169856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2453aa-13bb-4cff-9156-a24c09e65ba6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:03.218461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852505a8-3c15-4521-9022-64cc3532e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.220888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852505a8-3c15-4521-9022-64cc3532e529 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.221394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852505a8-3c15-4521-9022-64cc3532e529 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.221877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852505a8-3c15-4521-9022-64cc3532e529 None admin] PATH_INFO: `/v3/users/70ffe2ec3c4e406796db401ddf73f909` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.223367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852505a8-3c15-4521-9022-64cc3532e529 None admin] RBAC: Authorizing `identity:get_user(user_id=70ffe2ec3c4e406796db401ddf73f909)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:03.225078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852505a8-3c15-4521-9022-64cc3532e529 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:03.227653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 54/111] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:03 2022] GET /identity/v3/users/70ffe2ec3c4e406796db401ddf73f909 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:03.229130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d621a-36f3-4bac-bd99-bd2aa039abe8 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.229621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d621a-36f3-4bac-bd99-bd2aa039abe8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.230093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d621a-36f3-4bac-bd99-bd2aa039abe8 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.231571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 55/112] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:03.232309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d621a-36f3-4bac-bd99-bd2aa039abe8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.261380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:03.265420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:03.272283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d700e45-0415-4eed-913d-aa487b1241a3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:03.320779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281d936-c1d6-4000-9808-8de3484c54a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.321873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281d936-c1d6-4000-9808-8de3484c54a7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.322361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281d936-c1d6-4000-9808-8de3484c54a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.322840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281d936-c1d6-4000-9808-8de3484c54a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.323807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281d936-c1d6-4000-9808-8de3484c54a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:03.324364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281d936-c1d6-4000-9808-8de3484c54a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:03.326604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281d936-c1d6-4000-9808-8de3484c54a7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:03.338852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 58/113] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:03.341166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f8d31-ba9d-4b23-8d41-07c1771139d5 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.341662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f8d31-ba9d-4b23-8d41-07c1771139d5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.342368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f8d31-ba9d-4b23-8d41-07c1771139d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.354042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d621a-36f3-4bac-bd99-bd2aa039abe8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:03.364482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a87f8d31-ba9d-4b23-8d41-07c1771139d5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:03.366794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a87f8d31-ba9d-4b23-8d41-07c1771139d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:03.393233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63129fb-ccdb-4234-8af2-115dc1334a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.394171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63129fb-ccdb-4234-8af2-115dc1334a66 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.394568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63129fb-ccdb-4234-8af2-115dc1334a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.394918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63129fb-ccdb-4234-8af2-115dc1334a66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.406247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63129fb-ccdb-4234-8af2-115dc1334a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b63129fb-ccdb-4234-8af2-115dc1334a66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:03.415302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:03.416199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:03.416960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 56/114] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:58:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:03.417584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63129fb-ccdb-4234-8af2-115dc1334a66 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.462908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 59/115] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:03.464076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f8d31-ba9d-4b23-8d41-07c1771139d5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.532253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:03.554965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63129fb-ccdb-4234-8af2-115dc1334a66 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:03.575399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:03.587642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f8d31-ba9d-4b23-8d41-07c1771139d5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:03.600890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf22ba-c904-46dd-8ece-d78483ba876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.601981 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf22ba-c904-46dd-8ece-d78483ba876f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.602655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf22ba-c904-46dd-8ece-d78483ba876f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.603102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf22ba-c904-46dd-8ece-d78483ba876f None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.605229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf22ba-c904-46dd-8ece-d78483ba876f None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:03.607455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf22ba-c904-46dd-8ece-d78483ba876f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:03.609364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 57/116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:03 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:03.610804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf22ba-c904-46dd-8ece-d78483ba876f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.634207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70718c44-d66c-41f2-a541-f47cbcdfaf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.635319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70718c44-d66c-41f2-a541-f47cbcdfaf65 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.635744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70718c44-d66c-41f2-a541-f47cbcdfaf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.636323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70718c44-d66c-41f2-a541-f47cbcdfaf65 None admin] PATH_INFO: `/v3/users/32c7a15327b54d01ac606dcc00c79984` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.651633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70718c44-d66c-41f2-a541-f47cbcdfaf65 None admin] RBAC: Authorizing `identity:get_user(user_id=32c7a15327b54d01ac606dcc00c79984)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:03.653163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70718c44-d66c-41f2-a541-f47cbcdfaf65 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:03.654875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 60/117] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:03 2022] GET /identity/v3/users/32c7a15327b54d01ac606dcc00c79984 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:03.656782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70718c44-d66c-41f2-a541-f47cbcdfaf65 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.720384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf22ba-c904-46dd-8ece-d78483ba876f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:03.758969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7c66b-e42a-42c5-9c26-e1caa5cde182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.760245 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7c66b-e42a-42c5-9c26-e1caa5cde182 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.760909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7c66b-e42a-42c5-9c26-e1caa5cde182 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.761333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7c66b-e42a-42c5-9c26-e1caa5cde182 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.762658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7c66b-e42a-42c5-9c26-e1caa5cde182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:03.763373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7c66b-e42a-42c5-9c26-e1caa5cde182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:03.764906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7c66b-e42a-42c5-9c26-e1caa5cde182 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:03.765177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70718c44-d66c-41f2-a541-f47cbcdfaf65 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:03.774575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 58/118] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:03.775141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7c66b-e42a-42c5-9c26-e1caa5cde182 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.790586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:03.807461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b163cd4-8b4a-4856-989c-c088a25a7a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.808211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b163cd4-8b4a-4856-989c-c088a25a7a7e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.808501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b163cd4-8b4a-4856-989c-c088a25a7a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.808782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b163cd4-8b4a-4856-989c-c088a25a7a7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.819434 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b163cd4-8b4a-4856-989c-c088a25a7a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-7b163cd4-8b4a-4856-989c-c088a25a7a7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:03.827176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:03.828047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:03.828806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 61/119] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:03.829992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f999692-302b-4474-85cf-f36eaf596932 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.829992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f999692-302b-4474-85cf-f36eaf596932 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.830191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f999692-302b-4474-85cf-f36eaf596932 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.836312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 62/120] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:03.836312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f999692-302b-4474-85cf-f36eaf596932 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.846832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:03.896286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7c66b-e42a-42c5-9c26-e1caa5cde182 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:03.931756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b2832-e3bd-47df-a089-176e193356b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.932932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b2832-e3bd-47df-a089-176e193356b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.933376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b2832-e3bd-47df-a089-176e193356b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.933664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b2832-e3bd-47df-a089-176e193356b1 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08/users/70ffe2ec3c4e406796db401ddf73f909/roles/61fdd4e4d3c546ec97b97285ad1f80cd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:03.935962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b2832-e3bd-47df-a089-176e193356b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=18959bc99d074db3beb4a507e6e95b08, user_id=70ffe2ec3c4e406796db401ddf73f909, role_id=61fdd4e4d3c546ec97b97285ad1f80cd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:03.937442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b2832-e3bd-47df-a089-176e193356b1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:03.946314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f999692-302b-4474-85cf-f36eaf596932 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:03.952555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 59/121] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:58:03 2022] PUT /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08/users/70ffe2ec3c4e406796db401ddf73f909/roles/61fdd4e4d3c546ec97b97285ad1f80cd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:03.953126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b2832-e3bd-47df-a089-176e193356b1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:03.992607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809dea-b2f5-45ad-b536-7f960bd50b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:03.993281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809dea-b2f5-45ad-b536-7f960bd50b93 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:03.993619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809dea-b2f5-45ad-b536-7f960bd50b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:03.993917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809dea-b2f5-45ad-b536-7f960bd50b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.070759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:04.071256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9809dea-b2f5-45ad-b536-7f960bd50b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:04.073300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9809dea-b2f5-45ad-b536-7f960bd50b93 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:04.086924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:04.126950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b2832-e3bd-47df-a089-176e193356b1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:04.169715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ce2d2-43a0-40dc-8e07-09f60898a007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:04.170615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce2d2-43a0-40dc-8e07-09f60898a007 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:04.170910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce2d2-43a0-40dc-8e07-09f60898a007 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:04.171195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce2d2-43a0-40dc-8e07-09f60898a007 None admin] PATH_INFO: `/v3/users/9a1c8175bf58440a96c9e02fcf618584` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.173093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ce2d2-43a0-40dc-8e07-09f60898a007 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1c8175bf58440a96c9e02fcf618584)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:04.174594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ce2d2-43a0-40dc-8e07-09f60898a007 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:04.179922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 60/122] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:03 2022] GET /identity/v3/users/9a1c8175bf58440a96c9e02fcf618584 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:04.179922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ce2d2-43a0-40dc-8e07-09f60898a007 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:04.211220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 63/123] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:04.212954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f1064-ffaf-4b7f-b7b7-f38eaf9e35a8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:04.213412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f1064-ffaf-4b7f-b7b7-f38eaf9e35a8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:04.213858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f1064-ffaf-4b7f-b7b7-f38eaf9e35a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.235010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-dc5f1064-ffaf-4b7f-b7b7-f38eaf9e35a8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:04.236269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dc5f1064-ffaf-4b7f-b7b7-f38eaf9e35a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:04.297444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ce2d2-43a0-40dc-8e07-09f60898a007 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:04.304893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 64/124] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:04.305767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f1064-ffaf-4b7f-b7b7-f38eaf9e35a8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:04.335129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c336d-2f11-4cc2-bb4c-5e8142aa2600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:04.336199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c336d-2f11-4cc2-bb4c-5e8142aa2600 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:04.336690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c336d-2f11-4cc2-bb4c-5e8142aa2600 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:04.337189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c336d-2f11-4cc2-bb4c-5e8142aa2600 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.338147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c336d-2f11-4cc2-bb4c-5e8142aa2600 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:04.338675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c336d-2f11-4cc2-bb4c-5e8142aa2600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:04.340289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c336d-2f11-4cc2-bb4c-5e8142aa2600 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:04.349328 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 61/125] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:04.350467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c336d-2f11-4cc2-bb4c-5e8142aa2600 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:04.351508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:04.353666 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:04.435197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f1064-ffaf-4b7f-b7b7-f38eaf9e35a8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:04.457526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c336d-2f11-4cc2-bb4c-5e8142aa2600 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:04.479054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaef06-2d82-4233-8951-e28b51273dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:04.479949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaef06-2d82-4233-8951-e28b51273dba None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:04.480258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaef06-2d82-4233-8951-e28b51273dba None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:04.480846 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaef06-2d82-4233-8951-e28b51273dba None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.481724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaef06-2d82-4233-8951-e28b51273dba None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:04.483192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaef06-2d82-4233-8951-e28b51273dba None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:04.485187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 65/126] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:04 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:04.485965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaef06-2d82-4233-8951-e28b51273dba None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:04.496681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dfa06-077b-418a-b05f-99aa277edeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:04.497919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dfa06-077b-418a-b05f-99aa277edeaa None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:04.498406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dfa06-077b-418a-b05f-99aa277edeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:04.498881 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dfa06-077b-418a-b05f-99aa277edeaa None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.500340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9dfa06-077b-418a-b05f-99aa277edeaa None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:04.502011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9dfa06-077b-418a-b05f-99aa277edeaa None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:04.503966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 62/127] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:04 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:04.504934 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dfa06-077b-418a-b05f-99aa277edeaa None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:04.578131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:04.598473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaef06-2d82-4233-8951-e28b51273dba None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:04.608081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:04.621123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dfa06-077b-418a-b05f-99aa277edeaa None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:04.638628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093761be-cf12-41d4-80b6-b5855ef7c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:04.639764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093761be-cf12-41d4-80b6-b5855ef7c602 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:04.640291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093761be-cf12-41d4-80b6-b5855ef7c602 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:04.640793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093761be-cf12-41d4-80b6-b5855ef7c602 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.654651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093761be-cf12-41d4-80b6-b5855ef7c602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:04.661243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9ffc7-5d7f-45d0-97f7-6bd9ef9a54da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:04.662127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9ffc7-5d7f-45d0-97f7-6bd9ef9a54da None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:04.662414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9ffc7-5d7f-45d0-97f7-6bd9ef9a54da None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:04.662726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9ffc7-5d7f-45d0-97f7-6bd9ef9a54da None admin] PATH_INFO: `/v3/users/70ffe2ec3c4e406796db401ddf73f909` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.664038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9ffc7-5d7f-45d0-97f7-6bd9ef9a54da None admin] RBAC: Authorizing `identity:get_user(user_id=70ffe2ec3c4e406796db401ddf73f909)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-093761be-cf12-41d4-80b6-b5855ef7c602 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:04.664662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:04.665510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:04.666272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:04.666844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9ffc7-5d7f-45d0-97f7-6bd9ef9a54da None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:04.667373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 63/128] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:04 2022] GET /identity/v3/users/70ffe2ec3c4e406796db401ddf73f909 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:04.667856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9ffc7-5d7f-45d0-97f7-6bd9ef9a54da None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:04.669104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 66/129] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:04.670204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093761be-cf12-41d4-80b6-b5855ef7c602 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:04.791466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093761be-cf12-41d4-80b6-b5855ef7c602 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:04.804200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9ffc7-5d7f-45d0-97f7-6bd9ef9a54da None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:04.842835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eba32-4d61-485c-a208-cef15046e8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:04.843497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eba32-4d61-485c-a208-cef15046e8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:04.843798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eba32-4d61-485c-a208-cef15046e8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:04.844109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eba32-4d61-485c-a208-cef15046e8b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.845168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524eba32-4d61-485c-a208-cef15046e8b8 None admin] RBAC: Adding query filter params (role.id=186bf8f58360412bb8ab604514e2c321, scope.project.id=18959bc99d074db3beb4a507e6e95b08, user.id=32c7a15327b54d01ac606dcc00c79984) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:04.845489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524eba32-4d61-485c-a208-cef15046e8b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:04.847073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524eba32-4d61-485c-a208-cef15046e8b8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:04.848045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d1bec-6832-4c0e-982d-272a50450fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:04.849172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d1bec-6832-4c0e-982d-272a50450fa2 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:04.849654 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d1bec-6832-4c0e-982d-272a50450fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:04.850161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d1bec-6832-4c0e-982d-272a50450fa2 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08/users/9a1c8175bf58440a96c9e02fcf618584/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:04.853150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d1bec-6832-4c0e-982d-272a50450fa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=18959bc99d074db3beb4a507e6e95b08, user_id=9a1c8175bf58440a96c9e02fcf618584, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:04.853765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 67/130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:04 2022] GET /identity/v3/role_assignments?user.id=32c7a15327b54d01ac606dcc00c79984&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=186bf8f58360412bb8ab604514e2c321 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:04.854565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eba32-4d61-485c-a208-cef15046e8b8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:04.855553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d1bec-6832-4c0e-982d-272a50450fa2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:04.874812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:04.883493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 64/131] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:58:04 2022] PUT /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08/users/9a1c8175bf58440a96c9e02fcf618584/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:04.885379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d1bec-6832-4c0e-982d-272a50450fa2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:04.905612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:05.002517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eba32-4d61-485c-a208-cef15046e8b8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:05.051703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd4d7-68ea-4f41-9abf-4f4bb9ece3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:05.053203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd4d7-68ea-4f41-9abf-4f4bb9ece3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.054204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd4d7-68ea-4f41-9abf-4f4bb9ece3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.054585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd4d7-68ea-4f41-9abf-4f4bb9ece3e9 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.056033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd4d7-68ea-4f41-9abf-4f4bb9ece3e9 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:05.057663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd4d7-68ea-4f41-9abf-4f4bb9ece3e9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:05.060628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 68/132] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:04 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:05.066881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd4d7-68ea-4f41-9abf-4f4bb9ece3e9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:05.129145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d1bec-6832-4c0e-982d-272a50450fa2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:05.184657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac042f4-931d-4d1d-814d-a20c326c1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:05.185900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac042f4-931d-4d1d-814d-a20c326c1512 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.186359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac042f4-931d-4d1d-814d-a20c326c1512 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.187187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac042f4-931d-4d1d-814d-a20c326c1512 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.188211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac042f4-931d-4d1d-814d-a20c326c1512 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:05.188702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac042f4-931d-4d1d-814d-a20c326c1512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:05.190941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac042f4-931d-4d1d-814d-a20c326c1512 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:05.200820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:05.205329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 65/133] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:05.210962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd4d7-68ea-4f41-9abf-4f4bb9ece3e9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:05.212630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac042f4-931d-4d1d-814d-a20c326c1512 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:05.258844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba17ad4-673e-4825-97d7-7734536f95b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:05.259797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba17ad4-673e-4825-97d7-7734536f95b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.260900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba17ad4-673e-4825-97d7-7734536f95b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.261199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba17ad4-673e-4825-97d7-7734536f95b5 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08/users/70ffe2ec3c4e406796db401ddf73f909/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.263318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba17ad4-673e-4825-97d7-7734536f95b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=18959bc99d074db3beb4a507e6e95b08, user_id=70ffe2ec3c4e406796db401ddf73f909, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:05.264844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba17ad4-673e-4825-97d7-7734536f95b5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:05.282060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 69/134] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:58:05 2022] PUT /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08/users/70ffe2ec3c4e406796db401ddf73f909/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 21:58:05.302330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:05.351119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac042f4-931d-4d1d-814d-a20c326c1512 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:05.391302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd601d8e-2f44-4f04-bce5-fff778ee8ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:05.392222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd601d8e-2f44-4f04-bce5-fff778ee8ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.392524 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd601d8e-2f44-4f04-bce5-fff778ee8ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.392808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd601d8e-2f44-4f04-bce5-fff778ee8ab1 None admin] PATH_INFO: `/v3/users/70ffe2ec3c4e406796db401ddf73f909` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.394161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd601d8e-2f44-4f04-bce5-fff778ee8ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=70ffe2ec3c4e406796db401ddf73f909)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:05.395687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd601d8e-2f44-4f04-bce5-fff778ee8ab1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:05.400721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 66/135] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:05 2022] GET /identity/v3/users/70ffe2ec3c4e406796db401ddf73f909 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:05.404557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba17ad4-673e-4825-97d7-7734536f95b5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:05.417978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543f359-7971-4621-91ba-51893d9ff4dd None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.418337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543f359-7971-4621-91ba-51893d9ff4dd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.418576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543f359-7971-4621-91ba-51893d9ff4dd None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.423655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 67/136] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:05.430490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72199916-79c6-4ceb-89ae-c591c45bd40c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.430881 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72199916-79c6-4ceb-89ae-c591c45bd40c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.431167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72199916-79c6-4ceb-89ae-c591c45bd40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.476942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-72199916-79c6-4ceb-89ae-c591c45bd40c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:05.477922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-72199916-79c6-4ceb-89ae-c591c45bd40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:05.583721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba17ad4-673e-4825-97d7-7734536f95b5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:05.584782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 68/137] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:05.612064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72199916-79c6-4ceb-89ae-c591c45bd40c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:05.625776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d04cff-bc4c-4551-ad47-e73faab60b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:05.627112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d04cff-bc4c-4551-ad47-e73faab60b13 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.627542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d04cff-bc4c-4551-ad47-e73faab60b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.628006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d04cff-bc4c-4551-ad47-e73faab60b13 None admin] PATH_INFO: `/v3/projects/4fbd430abf3a4d769a67d30287795510` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.629481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d04cff-bc4c-4551-ad47-e73faab60b13 None admin] RBAC: Authorizing `identity:get_project(project_id=4fbd430abf3a4d769a67d30287795510)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:05.632713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d04cff-bc4c-4551-ad47-e73faab60b13 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:05.635037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 70/138] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:05 2022] GET /identity/v3/projects/4fbd430abf3a4d769a67d30287795510 => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:05.642372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d04cff-bc4c-4551-ad47-e73faab60b13 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:05.674704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:05.676495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:05.724469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72199916-79c6-4ceb-89ae-c591c45bd40c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:05.761449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d04cff-bc4c-4551-ad47-e73faab60b13 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:05.763527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab3c1-f4af-4620-b180-04b3737e5642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:05.764992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab3c1-f4af-4620-b180-04b3737e5642 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.764992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab3c1-f4af-4620-b180-04b3737e5642 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.765234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab3c1-f4af-4620-b180-04b3737e5642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.766502 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ab3c1-f4af-4620-b180-04b3737e5642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:05.768101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ab3c1-f4af-4620-b180-04b3737e5642 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:05.770185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 69/139] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:05.776787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab3c1-f4af-4620-b180-04b3737e5642 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:05.800725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32316-3c53-40ce-b7e6-b28ec282de54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:05.801885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32316-3c53-40ce-b7e6-b28ec282de54 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.802318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32316-3c53-40ce-b7e6-b28ec282de54 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.802762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32316-3c53-40ce-b7e6-b28ec282de54 None admin] PATH_INFO: `/v3/projects/4fbd430abf3a4d769a67d30287795510/users/70ffe2ec3c4e406796db401ddf73f909/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.805172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32316-3c53-40ce-b7e6-b28ec282de54 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fbd430abf3a4d769a67d30287795510, user_id=70ffe2ec3c4e406796db401ddf73f909, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:05.806907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32316-3c53-40ce-b7e6-b28ec282de54 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:05.832040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 71/140] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:58:05 2022] PUT /identity/v3/projects/4fbd430abf3a4d769a67d30287795510/users/70ffe2ec3c4e406796db401ddf73f909/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:05.902153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab3c1-f4af-4620-b180-04b3737e5642 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:05.930863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:05.942884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c43cf-8329-454d-a256-1bd53da588c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:05.943645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c43cf-8329-454d-a256-1bd53da588c8 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:05.944565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c43cf-8329-454d-a256-1bd53da588c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:05.944950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c43cf-8329-454d-a256-1bd53da588c8 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:05.945977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c43cf-8329-454d-a256-1bd53da588c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:05.947453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c43cf-8329-454d-a256-1bd53da588c8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:05.976095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 70/141] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:05 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 21:58:06.719359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c719cff-b609-4ac3-aa24-596d01d2d01b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:06.719889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c719cff-b609-4ac3-aa24-596d01d2d01b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:06.719999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c719cff-b609-4ac3-aa24-596d01d2d01b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:06.721642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 72/142] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:06.731173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e8bd0-6021-438a-a21c-05b490a0da36 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:06.731639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e8bd0-6021-438a-a21c-05b490a0da36 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:06.731837 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e8bd0-6021-438a-a21c-05b490a0da36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:06.757006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2a6e8bd0-6021-438a-a21c-05b490a0da36 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:06.758241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2a6e8bd0-6021-438a-a21c-05b490a0da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:06.844086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 71/143] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:06.880875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c719cff-b609-4ac3-aa24-596d01d2d01b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:06.984539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:07.004268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c719cff-b609-4ac3-aa24-596d01d2d01b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:07.043095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e165cc7-f459-4c5d-9d34-876d9acd51b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:07.043925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165cc7-f459-4c5d-9d34-876d9acd51b2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:07.044227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165cc7-f459-4c5d-9d34-876d9acd51b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:07.044512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165cc7-f459-4c5d-9d34-876d9acd51b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:07.063783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e165cc7-f459-4c5d-9d34-876d9acd51b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-3e165cc7-f459-4c5d-9d34-876d9acd51b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:07.073553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:07.074431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:07.075212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 73/144] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:07.081800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e8bd0-6021-438a-a21c-05b490a0da36 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:07.211315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e8bd0-6021-438a-a21c-05b490a0da36 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:07.233025 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:07.255805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c374c91-317e-44b3-a334-f7a5442acd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:07.257098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c374c91-317e-44b3-a334-f7a5442acd35 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:07.257512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c374c91-317e-44b3-a334-f7a5442acd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:07.257805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c374c91-317e-44b3-a334-f7a5442acd35 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:07.258595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c374c91-317e-44b3-a334-f7a5442acd35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:07.258912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c374c91-317e-44b3-a334-f7a5442acd35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:07.260335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c374c91-317e-44b3-a334-f7a5442acd35 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:07.275292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 72/145] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:07.280636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e165cc7-f459-4c5d-9d34-876d9acd51b2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:07.411867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e165cc7-f459-4c5d-9d34-876d9acd51b2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:07.450579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78305-ab18-48e8-88eb-7a5a1e91f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:07.451654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78305-ab18-48e8-88eb-7a5a1e91f560 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:07.451971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78305-ab18-48e8-88eb-7a5a1e91f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:07.452483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78305-ab18-48e8-88eb-7a5a1e91f560 None admin] PATH_INFO: `/v3/users/70ffe2ec3c4e406796db401ddf73f909` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:07.456681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd78305-ab18-48e8-88eb-7a5a1e91f560 None admin] RBAC: Authorizing `identity:get_user(user_id=70ffe2ec3c4e406796db401ddf73f909)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:07.458184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd78305-ab18-48e8-88eb-7a5a1e91f560 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:07.461164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 74/146] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:07 2022] GET /identity/v3/users/70ffe2ec3c4e406796db401ddf73f909 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:07.466653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c374c91-317e-44b3-a334-f7a5442acd35 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:07.580208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c374c91-317e-44b3-a334-f7a5442acd35 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:07.617730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32e08b-ea31-4817-a94e-c25848d96899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:07.618402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32e08b-ea31-4817-a94e-c25848d96899 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:07.618696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32e08b-ea31-4817-a94e-c25848d96899 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:07.618989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32e08b-ea31-4817-a94e-c25848d96899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:07.668390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:07.695156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32e08b-ea31-4817-a94e-c25848d96899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:07.696664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32e08b-ea31-4817-a94e-c25848d96899 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:07.812319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 73/147] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:07.817631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78305-ab18-48e8-88eb-7a5a1e91f560 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:07.836305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:07.927506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78305-ab18-48e8-88eb-7a5a1e91f560 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:07.934920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150328e6-df8d-4db6-9c7e-2d60e61aba3a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:07.935212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150328e6-df8d-4db6-9c7e-2d60e61aba3a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:07.935498 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150328e6-df8d-4db6-9c7e-2d60e61aba3a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:07.936924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 74/148] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:07.942379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331f5c2-5fd4-4991-bd5b-c50ee2d16c13 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:07.942672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331f5c2-5fd4-4991-bd5b-c50ee2d16c13 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:07.942959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331f5c2-5fd4-4991-bd5b-c50ee2d16c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:07.974595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7331f5c2-5fd4-4991-bd5b-c50ee2d16c13 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:07.976631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7331f5c2-5fd4-4991-bd5b-c50ee2d16c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:07.995344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de9b8-185c-4819-808e-da6033647dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:07.996285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de9b8-185c-4819-808e-da6033647dcb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:07.996570 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de9b8-185c-4819-808e-da6033647dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:07.996848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de9b8-185c-4819-808e-da6033647dcb None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:07.998099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de9b8-185c-4819-808e-da6033647dcb None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:07.999549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de9b8-185c-4819-808e-da6033647dcb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:08.001281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 75/149] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:07 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:08.008130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de9b8-185c-4819-808e-da6033647dcb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:08.061051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 75/150] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:08.103097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331f5c2-5fd4-4991-bd5b-c50ee2d16c13 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:08.119924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:08.234390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:08.283634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de9b8-185c-4819-808e-da6033647dcb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:08.294274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331f5c2-5fd4-4991-bd5b-c50ee2d16c13 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:08.354593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620c344-36d9-4b95-b045-24ad9bac0c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:08.355329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620c344-36d9-4b95-b045-24ad9bac0c6f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:08.355619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620c344-36d9-4b95-b045-24ad9bac0c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:08.355926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620c344-36d9-4b95-b045-24ad9bac0c6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:08.357023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479926-3273-4165-9ad0-9eb7db22eb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:08.357852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479926-3273-4165-9ad0-9eb7db22eb9f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:08.358274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479926-3273-4165-9ad0-9eb7db22eb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:08.358687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479926-3273-4165-9ad0-9eb7db22eb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:08.359666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db479926-3273-4165-9ad0-9eb7db22eb9f None admin] RBAC: Adding query filter params (role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=18959bc99d074db3beb4a507e6e95b08, user.id=70ffe2ec3c4e406796db401ddf73f909) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:08.360141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db479926-3273-4165-9ad0-9eb7db22eb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:08.361740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db479926-3273-4165-9ad0-9eb7db22eb9f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:08.375934 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620c344-36d9-4b95-b045-24ad9bac0c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:08.376843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 76/151] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:08 2022] GET /identity/v3/role_assignments?user.id=70ffe2ec3c4e406796db401ddf73f909&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 608 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-5620c344-36d9-4b95-b045-24ad9bac0c6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:08.390063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:08.391246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:08.392212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 76/152] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:08.399420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479926-3273-4165-9ad0-9eb7db22eb9f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:08.524919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479926-3273-4165-9ad0-9eb7db22eb9f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:08.567452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7839c-e953-4ea1-87fd-7be63f39a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:08.568179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7839c-e953-4ea1-87fd-7be63f39a543 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:08.568474 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7839c-e953-4ea1-87fd-7be63f39a543 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:08.569326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7839c-e953-4ea1-87fd-7be63f39a543 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:08.570198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7839c-e953-4ea1-87fd-7be63f39a543 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:08.570517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7839c-e953-4ea1-87fd-7be63f39a543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:08.572007 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7839c-e953-4ea1-87fd-7be63f39a543 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:08.585715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 77/153] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:08.591351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620c344-36d9-4b95-b045-24ad9bac0c6f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:08.646576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0f965-6385-490d-988f-c852f160327c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:08.646970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0f965-6385-490d-988f-c852f160327c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:08.647191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0f965-6385-490d-988f-c852f160327c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:08.648907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 78/154] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:08.654189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2620c-8637-4fe6-ac1b-639e70078d62 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:08.654478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2620c-8637-4fe6-ac1b-639e70078d62 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:08.654761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2620c-8637-4fe6-ac1b-639e70078d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:08.683119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-79b2620c-8637-4fe6-ac1b-639e70078d62 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:08.684460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-79b2620c-8637-4fe6-ac1b-639e70078d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:08.686184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:08.687423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:08.742879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620c344-36d9-4b95-b045-24ad9bac0c6f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:08.825546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688feef4-7594-4256-8c16-f198a301129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:08.826445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688feef4-7594-4256-8c16-f198a301129c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:08.826731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688feef4-7594-4256-8c16-f198a301129c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:08.827012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688feef4-7594-4256-8c16-f198a301129c None admin] PATH_INFO: `/v3/users/32c7a15327b54d01ac606dcc00c79984` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:08.827879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 79/155] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:08.832633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688feef4-7594-4256-8c16-f198a301129c None admin] RBAC: Authorizing `identity:get_user(user_id=32c7a15327b54d01ac606dcc00c79984)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:08.834094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688feef4-7594-4256-8c16-f198a301129c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:08.836219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 77/156] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:08 2022] GET /identity/v3/users/32c7a15327b54d01ac606dcc00c79984 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:08.841715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2620c-8637-4fe6-ac1b-639e70078d62 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:08.918661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688feef4-7594-4256-8c16-f198a301129c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:08.974370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2620c-8637-4fe6-ac1b-639e70078d62 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:09.029980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e7a5e-6d44-4826-a2e7-49e67d65a553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:09.030866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e7a5e-6d44-4826-a2e7-49e67d65a553 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:09.031152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e7a5e-6d44-4826-a2e7-49e67d65a553 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:09.031430 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e7a5e-6d44-4826-a2e7-49e67d65a553 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:09.036630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e7a5e-6d44-4826-a2e7-49e67d65a553 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:09.038186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e7a5e-6d44-4826-a2e7-49e67d65a553 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:09.043364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 80/157] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:08 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:09.073648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e7a5e-6d44-4826-a2e7-49e67d65a553 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:09.082828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:09.117498 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688feef4-7594-4256-8c16-f198a301129c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:09.188657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:09.198398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bf8be-bbf0-4e1f-bd67-4c79c1448fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:09.199221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf8be-bbf0-4e1f-bd67-4c79c1448fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:09.199510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf8be-bbf0-4e1f-bd67-4c79c1448fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:09.199792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf8be-bbf0-4e1f-bd67-4c79c1448fc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:09.225968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bf8be-bbf0-4e1f-bd67-4c79c1448fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-919bf8be-bbf0-4e1f-bd67-4c79c1448fc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:09.236916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:09.237869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:09.238651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:09.241589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 78/158] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:09.248319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bf8be-bbf0-4e1f-bd67-4c79c1448fc3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:09.276590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e7a5e-6d44-4826-a2e7-49e67d65a553 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:09.357148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b6224-353b-41a6-a856-00d9eb61b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:09.358427 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b6224-353b-41a6-a856-00d9eb61b4e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:09.358913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b6224-353b-41a6-a856-00d9eb61b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:09.359396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b6224-353b-41a6-a856-00d9eb61b4e4 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08/users/32c7a15327b54d01ac606dcc00c79984/roles/186bf8f58360412bb8ab604514e2c321` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:09.364964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b6224-353b-41a6-a856-00d9eb61b4e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=18959bc99d074db3beb4a507e6e95b08, user_id=32c7a15327b54d01ac606dcc00c79984, role_id=186bf8f58360412bb8ab604514e2c321)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:09.366735 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b6224-353b-41a6-a856-00d9eb61b4e4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:09.384833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bf8be-bbf0-4e1f-bd67-4c79c1448fc3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:09.401018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 81/159] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:58:09 2022] PUT /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08/users/32c7a15327b54d01ac606dcc00c79984/roles/186bf8f58360412bb8ab604514e2c321 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 21:58:09.402687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6faad7-76e2-4cdb-84f4-1eed5709ebdd None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:09.403193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6faad7-76e2-4cdb-84f4-1eed5709ebdd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:09.403667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6faad7-76e2-4cdb-84f4-1eed5709ebdd None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:09.405239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 82/160] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:09.410984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5a29-3581-46e2-9de6-4a5326411868 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:09.411587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5a29-3581-46e2-9de6-4a5326411868 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:09.412119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5a29-3581-46e2-9de6-4a5326411868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:09.439196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e23d0-8163-47b8-864d-59365a6badf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:09.440174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e23d0-8163-47b8-864d-59365a6badf8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:09.440677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e23d0-8163-47b8-864d-59365a6badf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:09.441092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e23d0-8163-47b8-864d-59365a6badf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:09.442058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e23d0-8163-47b8-864d-59365a6badf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:09.442515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e23d0-8163-47b8-864d-59365a6badf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:09.444993 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e23d0-8163-47b8-864d-59365a6badf8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:09.451059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f14c5a29-3581-46e2-9de6-4a5326411868 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:09.452430 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f14c5a29-3581-46e2-9de6-4a5326411868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:09.456041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 79/161] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:09.464986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e23d0-8163-47b8-864d-59365a6badf8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:09.541110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:09.596672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e23d0-8163-47b8-864d-59365a6badf8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:09.645803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:09.657194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4909ba-644a-4ab0-b575-b06ebd33aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:09.658464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4909ba-644a-4ab0-b575-b06ebd33aef6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:09.658973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4909ba-644a-4ab0-b575-b06ebd33aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:09.659443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4909ba-644a-4ab0-b575-b06ebd33aef6 None admin] PATH_INFO: `/v3/users/70ffe2ec3c4e406796db401ddf73f909` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:09.661885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4909ba-644a-4ab0-b575-b06ebd33aef6 None admin] RBAC: Authorizing `identity:get_user(user_id=70ffe2ec3c4e406796db401ddf73f909)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:09.663625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4909ba-644a-4ab0-b575-b06ebd33aef6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:09.665674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 80/162] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:09 2022] GET /identity/v3/users/70ffe2ec3c4e406796db401ddf73f909 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:09.672366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4909ba-644a-4ab0-b575-b06ebd33aef6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:09.677872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 83/163] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:09.726078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5a29-3581-46e2-9de6-4a5326411868 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:09.839774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4909ba-644a-4ab0-b575-b06ebd33aef6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:09.870712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:09.886425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbed475-aed4-4bac-a971-533400fb7e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:09.887409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbed475-aed4-4bac-a971-533400fb7e88 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:09.887833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbed475-aed4-4bac-a971-533400fb7e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:09.888277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbed475-aed4-4bac-a971-533400fb7e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:09.951184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5a29-3581-46e2-9de6-4a5326411868 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:10.019350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbed475-aed4-4bac-a971-533400fb7e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:10.020854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbed475-aed4-4bac-a971-533400fb7e88 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:10.021471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9b297-a521-45e0-a363-947bbd5de79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:10.022706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9b297-a521-45e0-a363-947bbd5de79c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.023196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9b297-a521-45e0-a363-947bbd5de79c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.023695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9b297-a521-45e0-a363-947bbd5de79c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.048177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9b297-a521-45e0-a363-947bbd5de79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2de9b297-a521-45e0-a363-947bbd5de79c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:10.056519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:10.057392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:10.058148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 84/164] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:10.065354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086e0e-93bd-4331-ba0f-55251dc95b66 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.065973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086e0e-93bd-4331-ba0f-55251dc95b66 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.066267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086e0e-93bd-4331-ba0f-55251dc95b66 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.068026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 85/165] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:10.069310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086e0e-93bd-4331-ba0f-55251dc95b66 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:10.195210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:10.247699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086e0e-93bd-4331-ba0f-55251dc95b66 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:10.283816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250b3e0-c4f1-417c-a168-a52214d4f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:10.284906 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250b3e0-c4f1-417c-a168-a52214d4f068 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.285333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250b3e0-c4f1-417c-a168-a52214d4f068 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.285757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250b3e0-c4f1-417c-a168-a52214d4f068 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.286646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250b3e0-c4f1-417c-a168-a52214d4f068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:10.287147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250b3e0-c4f1-417c-a168-a52214d4f068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:10.289237 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250b3e0-c4f1-417c-a168-a52214d4f068 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:10.297817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 81/166] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:10.299315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89884eab-a566-4726-836d-33cfc02ef2ce None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.299757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89884eab-a566-4726-836d-33cfc02ef2ce None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.300101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 86/167] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:10.304117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250b3e0-c4f1-417c-a168-a52214d4f068 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:10.304619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89884eab-a566-4726-836d-33cfc02ef2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.327732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-89884eab-a566-4726-836d-33cfc02ef2ce None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:10.333026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-89884eab-a566-4726-836d-33cfc02ef2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:10.373219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:10.450453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 82/168] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:10.451331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89884eab-a566-4726-836d-33cfc02ef2ce None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:10.483877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250b3e0-c4f1-417c-a168-a52214d4f068 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:10.514663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:10.535580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f97ad-5595-49ca-b34b-b215ab1c18c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:10.536391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f97ad-5595-49ca-b34b-b215ab1c18c9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.536674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f97ad-5595-49ca-b34b-b215ab1c18c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.536945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f97ad-5595-49ca-b34b-b215ab1c18c9 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.538180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f97ad-5595-49ca-b34b-b215ab1c18c9 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:10.539634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f97ad-5595-49ca-b34b-b215ab1c18c9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:10.541938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 87/169] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:10 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:10.543396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa07b5f-20c4-4a6c-8b3d-16bb408041b3 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.544001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa07b5f-20c4-4a6c-8b3d-16bb408041b3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.544450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa07b5f-20c4-4a6c-8b3d-16bb408041b3 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.545883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 88/170] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:10.546834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa07b5f-20c4-4a6c-8b3d-16bb408041b3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:10.671871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa07b5f-20c4-4a6c-8b3d-16bb408041b3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:10.712945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf84b4-c7f3-4490-ba89-4e09c88925ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:10.714024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf84b4-c7f3-4490-ba89-4e09c88925ec None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.714451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf84b4-c7f3-4490-ba89-4e09c88925ec None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.714866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf84b4-c7f3-4490-ba89-4e09c88925ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.727729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf84b4-c7f3-4490-ba89-4e09c88925ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-78bf84b4-c7f3-4490-ba89-4e09c88925ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:10.736461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:10.737493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:10.738442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:10.745283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 89/171] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:10.746438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf84b4-c7f3-4490-ba89-4e09c88925ec None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:10.748964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89884eab-a566-4726-836d-33cfc02ef2ce None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:10.804955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:10.853203 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf992724-a79d-45a3-8889-8c6f22d36ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:10.854106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992724-a79d-45a3-8889-8c6f22d36ffe None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.854399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992724-a79d-45a3-8889-8c6f22d36ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.854690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf992724-a79d-45a3-8889-8c6f22d36ffe None admin] PATH_INFO: `/v3/users/9a1c8175bf58440a96c9e02fcf618584` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.855925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf992724-a79d-45a3-8889-8c6f22d36ffe None admin] RBAC: Authorizing `identity:get_user(user_id=9a1c8175bf58440a96c9e02fcf618584)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:10.857392 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf992724-a79d-45a3-8889-8c6f22d36ffe None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:10.859527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 83/172] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:10 2022] GET /identity/v3/users/9a1c8175bf58440a96c9e02fcf618584 => generated 247 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:10.862334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127a83-758d-423a-b5a3-b47eed7101e5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.862334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127a83-758d-423a-b5a3-b47eed7101e5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.862334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127a83-758d-423a-b5a3-b47eed7101e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.887120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf84b4-c7f3-4490-ba89-4e09c88925ec None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:10.897353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bf127a83-758d-423a-b5a3-b47eed7101e5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:10.898175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bf127a83-758d-423a-b5a3-b47eed7101e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:10.925073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:10.945086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3b7ff-cd74-48d7-aa58-ac9e2730ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:10.946683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3b7ff-cd74-48d7-aa58-ac9e2730ef3e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:10.947670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3b7ff-cd74-48d7-aa58-ac9e2730ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:10.947970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3b7ff-cd74-48d7-aa58-ac9e2730ef3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:10.949729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3b7ff-cd74-48d7-aa58-ac9e2730ef3e None admin] RBAC: Adding query filter params (role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=18959bc99d074db3beb4a507e6e95b08, user.id=70ffe2ec3c4e406796db401ddf73f909) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:10.950045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3b7ff-cd74-48d7-aa58-ac9e2730ef3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:10.952628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3b7ff-cd74-48d7-aa58-ac9e2730ef3e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:10.964628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 90/173] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:10 2022] GET /identity/v3/role_assignments?user.id=70ffe2ec3c4e406796db401ddf73f909&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:10.965461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3b7ff-cd74-48d7-aa58-ac9e2730ef3e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:11.032238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 84/174] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:11.033128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf127a83-758d-423a-b5a3-b47eed7101e5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:11.157872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3b7ff-cd74-48d7-aa58-ac9e2730ef3e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:11.173252 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:11.199733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ac2df-83fe-4f24-aae4-469e542f9e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:11.200593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac2df-83fe-4f24-aae4-469e542f9e01 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.200944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac2df-83fe-4f24-aae4-469e542f9e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.201334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac2df-83fe-4f24-aae4-469e542f9e01 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.202185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ac2df-83fe-4f24-aae4-469e542f9e01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:11.202561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ac2df-83fe-4f24-aae4-469e542f9e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:11.204148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ac2df-83fe-4f24-aae4-469e542f9e01 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:11.214784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 91/175] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:11.215633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ac2df-83fe-4f24-aae4-469e542f9e01 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:11.217979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf127a83-758d-423a-b5a3-b47eed7101e5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:11.254937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af90d1-1f93-47fa-9ff7-fd8f787c579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:11.255634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af90d1-1f93-47fa-9ff7-fd8f787c579a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.255948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af90d1-1f93-47fa-9ff7-fd8f787c579a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.256275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af90d1-1f93-47fa-9ff7-fd8f787c579a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.280087 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:11.338794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af90d1-1f93-47fa-9ff7-fd8f787c579a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:11.339100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ac2df-83fe-4f24-aae4-469e542f9e01 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:11.340304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af90d1-1f93-47fa-9ff7-fd8f787c579a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:11.376793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d1550-0cbc-4bae-b4b5-07b7f5b763b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:11.377617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d1550-0cbc-4bae-b4b5-07b7f5b763b4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.377899 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d1550-0cbc-4bae-b4b5-07b7f5b763b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.378172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d1550-0cbc-4bae-b4b5-07b7f5b763b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.388385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d1550-0cbc-4bae-b4b5-07b7f5b763b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-a80d1550-0cbc-4bae-b4b5-07b7f5b763b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:11.395935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:11.397345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:11.398272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 92/176] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:11.399148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d169ef-fd77-4123-a727-96366d691a73 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.399569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d169ef-fd77-4123-a727-96366d691a73 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.399828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d169ef-fd77-4123-a727-96366d691a73 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.401255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 93/177] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:11.402592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bcf2f-08e1-42bc-a0b7-aee973e82769 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.402884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bcf2f-08e1-42bc-a0b7-aee973e82769 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.403156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bcf2f-08e1-42bc-a0b7-aee973e82769 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.408180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 94/178] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:11.408180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bcf2f-08e1-42bc-a0b7-aee973e82769 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:11.438484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:11.458164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 85/179] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:11.458164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af90d1-1f93-47fa-9ff7-fd8f787c579a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:11.510693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:11.523815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bcf2f-08e1-42bc-a0b7-aee973e82769 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:11.559987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d7ef7-ea16-4aa6-b733-669d1cd639df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:11.561167 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d7ef7-ea16-4aa6-b733-669d1cd639df None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.561273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af90d1-1f93-47fa-9ff7-fd8f787c579a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:11.561801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d7ef7-ea16-4aa6-b733-669d1cd639df None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.562275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d7ef7-ea16-4aa6-b733-669d1cd639df None admin] PATH_INFO: `/v3/users/70ffe2ec3c4e406796db401ddf73f909` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.563667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d7ef7-ea16-4aa6-b733-669d1cd639df None admin] RBAC: Authorizing `identity:get_user(user_id=70ffe2ec3c4e406796db401ddf73f909)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:11.565200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d7ef7-ea16-4aa6-b733-669d1cd639df None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:11.567010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 95/180] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:11 2022] GET /identity/v3/users/70ffe2ec3c4e406796db401ddf73f909 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:11.568059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcc55-a9eb-4c49-99b3-1154cb25e684 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.568347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcc55-a9eb-4c49-99b3-1154cb25e684 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.569346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcc55-a9eb-4c49-99b3-1154cb25e684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.586903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-19cdcc55-a9eb-4c49-99b3-1154cb25e684 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:11.588114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-19cdcc55-a9eb-4c49-99b3-1154cb25e684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:11.602215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dff94-fd98-4e42-803d-2968db441d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:11.602882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dff94-fd98-4e42-803d-2968db441d33 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.603169 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dff94-fd98-4e42-803d-2968db441d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.603446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dff94-fd98-4e42-803d-2968db441d33 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.604216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dff94-fd98-4e42-803d-2968db441d33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:11.604521 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dff94-fd98-4e42-803d-2968db441d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:11.605875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dff94-fd98-4e42-803d-2968db441d33 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:11.614201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 86/181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:11.615744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5c39-1097-44b5-bdff-96bf35e3c911 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.616068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5c39-1097-44b5-bdff-96bf35e3c911 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.616349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5c39-1097-44b5-bdff-96bf35e3c911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.632427 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-79fb5c39-1097-44b5-bdff-96bf35e3c911 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:11.633526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-79fb5c39-1097-44b5-bdff-96bf35e3c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:11.662470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 96/182] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:11.663512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdcc55-a9eb-4c49-99b3-1154cb25e684 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:11.703531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:11.712581 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 87/183] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:11.713446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5c39-1097-44b5-bdff-96bf35e3c911 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:11.767001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:11.788473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdcc55-a9eb-4c49-99b3-1154cb25e684 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:11.828351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5c39-1097-44b5-bdff-96bf35e3c911 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:11.829803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe30e6-467e-4aa0-88f5-fdb5c7e7bbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:11.831209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe30e6-467e-4aa0-88f5-fdb5c7e7bbac None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.831808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe30e6-467e-4aa0-88f5-fdb5c7e7bbac None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.832783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe30e6-467e-4aa0-88f5-fdb5c7e7bbac None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.833655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe30e6-467e-4aa0-88f5-fdb5c7e7bbac None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:11.836931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe30e6-467e-4aa0-88f5-fdb5c7e7bbac None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:11.843513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 97/184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:11 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:11.843513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe30e6-467e-4aa0-88f5-fdb5c7e7bbac None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:11.869888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98eaf1-a3eb-462d-b58f-6b620fe5dbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:11.870664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98eaf1-a3eb-462d-b58f-6b620fe5dbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.870955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98eaf1-a3eb-462d-b58f-6b620fe5dbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.871238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98eaf1-a3eb-462d-b58f-6b620fe5dbc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:11.945935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:11.949877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe30e6-467e-4aa0-88f5-fdb5c7e7bbac None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:11.950781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98eaf1-a3eb-462d-b58f-6b620fe5dbc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:11.953097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98eaf1-a3eb-462d-b58f-6b620fe5dbc3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:11.983862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a0748-0ffe-4fd7-84e8-f72cde6c5347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:11.984776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a0748-0ffe-4fd7-84e8-f72cde6c5347 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:11.985060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a0748-0ffe-4fd7-84e8-f72cde6c5347 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:11.985337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a0748-0ffe-4fd7-84e8-f72cde6c5347 None admin] PATH_INFO: `/v3/users/62021fc44d1d46b4bb546313a7051d59` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.000118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a0748-0ffe-4fd7-84e8-f72cde6c5347 None admin] RBAC: Authorizing `identity:get_user(user_id=62021fc44d1d46b4bb546313a7051d59)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:12.001577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a0748-0ffe-4fd7-84e8-f72cde6c5347 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:12.001824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:12.003961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 98/185] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:11 2022] GET /identity/v3/users/62021fc44d1d46b4bb546313a7051d59 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:12.005081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a0748-0ffe-4fd7-84e8-f72cde6c5347 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.068162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 88/186] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:12.068162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98eaf1-a3eb-462d-b58f-6b620fe5dbc3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.123755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a0748-0ffe-4fd7-84e8-f72cde6c5347 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:12.160828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19607bc-5745-407a-a64a-e6381044e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:12.161637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19607bc-5745-407a-a64a-e6381044e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.161923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19607bc-5745-407a-a64a-e6381044e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.162199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19607bc-5745-407a-a64a-e6381044e6c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.163440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19607bc-5745-407a-a64a-e6381044e6c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:12.164945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19607bc-5745-407a-a64a-e6381044e6c5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:12.166587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 99/187] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:12.171748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19607bc-5745-407a-a64a-e6381044e6c5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.183220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98eaf1-a3eb-462d-b58f-6b620fe5dbc3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:12.199157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:12.222681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62658b9-7e2f-4313-8b1d-53a8b2fb6907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:12.223501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62658b9-7e2f-4313-8b1d-53a8b2fb6907 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.223806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62658b9-7e2f-4313-8b1d-53a8b2fb6907 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.224116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62658b9-7e2f-4313-8b1d-53a8b2fb6907 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.234860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62658b9-7e2f-4313-8b1d-53a8b2fb6907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-d62658b9-7e2f-4313-8b1d-53a8b2fb6907 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:12.243947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:12.244926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:12.245706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 89/188] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:12.246372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62658b9-7e2f-4313-8b1d-53a8b2fb6907 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.248776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:12.285651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19607bc-5745-407a-a64a-e6381044e6c5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:12.321398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280657e-4939-4b7a-9f90-537dcce3bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:12.322056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280657e-4939-4b7a-9f90-537dcce3bc3c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.322343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280657e-4939-4b7a-9f90-537dcce3bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.322617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280657e-4939-4b7a-9f90-537dcce3bc3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.323455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280657e-4939-4b7a-9f90-537dcce3bc3c None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=18959bc99d074db3beb4a507e6e95b08, user.id=9a1c8175bf58440a96c9e02fcf618584) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:12.323768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280657e-4939-4b7a-9f90-537dcce3bc3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:12.325232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280657e-4939-4b7a-9f90-537dcce3bc3c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:12.331035 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 100/189] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/role_assignments?user.id=9a1c8175bf58440a96c9e02fcf618584&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:12.331798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280657e-4939-4b7a-9f90-537dcce3bc3c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.357578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62658b9-7e2f-4313-8b1d-53a8b2fb6907 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:12.398114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfaf29-175d-451c-a287-f089152d7411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:12.398789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfaf29-175d-451c-a287-f089152d7411 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.399066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfaf29-175d-451c-a287-f089152d7411 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.399346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfaf29-175d-451c-a287-f089152d7411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.434933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:12.448371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280657e-4939-4b7a-9f90-537dcce3bc3c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:12.482753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfaf29-175d-451c-a287-f089152d7411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:12.484257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfaf29-175d-451c-a287-f089152d7411 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:12.486146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:12.489753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954a33-e5b0-449f-8830-88152804325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:12.491392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954a33-e5b0-449f-8830-88152804325c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.491592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954a33-e5b0-449f-8830-88152804325c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.491824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954a33-e5b0-449f-8830-88152804325c None admin] PATH_INFO: `/v3/projects/4fbd430abf3a4d769a67d30287795510` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.495924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954a33-e5b0-449f-8830-88152804325c None admin] RBAC: Authorizing `identity:get_project(project_id=4fbd430abf3a4d769a67d30287795510)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:12.495924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954a33-e5b0-449f-8830-88152804325c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:12.497324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 101/190] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/projects/4fbd430abf3a4d769a67d30287795510 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:12.498084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954a33-e5b0-449f-8830-88152804325c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.603465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 90/191] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:12.603465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfaf29-175d-451c-a287-f089152d7411 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.611790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954a33-e5b0-449f-8830-88152804325c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:12.646325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b76e76-730b-4987-bccc-99f8076bca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:12.647610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b76e76-730b-4987-bccc-99f8076bca55 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.648073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b76e76-730b-4987-bccc-99f8076bca55 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.648357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b76e76-730b-4987-bccc-99f8076bca55 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.649071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b76e76-730b-4987-bccc-99f8076bca55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:12.650525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b76e76-730b-4987-bccc-99f8076bca55 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:12.674995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 102/192] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:12 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:12.674995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4957b05-8f5d-43c6-a7c1-b74a2e0ad604 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.674995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4957b05-8f5d-43c6-a7c1-b74a2e0ad604 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.674995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4957b05-8f5d-43c6-a7c1-b74a2e0ad604 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.674995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 103/193] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:12.674995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4957b05-8f5d-43c6-a7c1-b74a2e0ad604 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.699937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:12.714121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfaf29-175d-451c-a287-f089152d7411 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:12.716760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:12.762601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9f50-b8b4-46c3-899f-00d364982218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:12.763202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9f50-b8b4-46c3-899f-00d364982218 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.763488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9f50-b8b4-46c3-899f-00d364982218 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.763769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9f50-b8b4-46c3-899f-00d364982218 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.764632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9f50-b8b4-46c3-899f-00d364982218 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:12.764950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9f50-b8b4-46c3-899f-00d364982218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:12.766325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9f50-b8b4-46c3-899f-00d364982218 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:12.776427 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 91/194] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:12.777086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9f50-b8b4-46c3-899f-00d364982218 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.806571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4957b05-8f5d-43c6-a7c1-b74a2e0ad604 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:12.851671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbe7fa-bf7d-4a55-9ad7-573563231f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:12.852458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbe7fa-bf7d-4a55-9ad7-573563231f11 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.852680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbe7fa-bf7d-4a55-9ad7-573563231f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.852967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbe7fa-bf7d-4a55-9ad7-573563231f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.853822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbe7fa-bf7d-4a55-9ad7-573563231f11 None admin] RBAC: Adding query filter params (role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=4fbd430abf3a4d769a67d30287795510, user.id=70ffe2ec3c4e406796db401ddf73f909) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:12.854144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbe7fa-bf7d-4a55-9ad7-573563231f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:12.855613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbe7fa-bf7d-4a55-9ad7-573563231f11 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:12.862467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 104/195] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/role_assignments?user.id=70ffe2ec3c4e406796db401ddf73f909&scope.project.id=4fbd430abf3a4d769a67d30287795510&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:12.863696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcafb8-f568-40f3-86c1-cb49f555dc83 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.864039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcafb8-f568-40f3-86c1-cb49f555dc83 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.864323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcafb8-f568-40f3-86c1-cb49f555dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.888543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-93fcafb8-f568-40f3-86c1-cb49f555dc83 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:12.889815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-93fcafb8-f568-40f3-86c1-cb49f555dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:12.910203 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9f50-b8b4-46c3-899f-00d364982218 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:12.951254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd55f9-bad3-41f1-a1ab-8b44469b70cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:12.952178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd55f9-bad3-41f1-a1ab-8b44469b70cb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:12.952583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd55f9-bad3-41f1-a1ab-8b44469b70cb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:12.952876 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd55f9-bad3-41f1-a1ab-8b44469b70cb None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:12.954153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd55f9-bad3-41f1-a1ab-8b44469b70cb None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:12.955760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd55f9-bad3-41f1-a1ab-8b44469b70cb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:12.958281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 92/196] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:12.958510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd55f9-bad3-41f1-a1ab-8b44469b70cb None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.987624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 105/197] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:12.988770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcafb8-f568-40f3-86c1-cb49f555dc83 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:12.999078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:13.009458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:13.112367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd55f9-bad3-41f1-a1ab-8b44469b70cb None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:13.136859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcafb8-f568-40f3-86c1-cb49f555dc83 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:13.164759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef9388-ec29-4b31-b24e-449eed6f033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:13.165820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef9388-ec29-4b31-b24e-449eed6f033e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:13.166221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef9388-ec29-4b31-b24e-449eed6f033e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:13.166631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef9388-ec29-4b31-b24e-449eed6f033e None admin] PATH_INFO: `/v3/users/62021fc44d1d46b4bb546313a7051d59` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:13.169308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef9388-ec29-4b31-b24e-449eed6f033e None admin] RBAC: Authorizing `identity:get_user(user_id=62021fc44d1d46b4bb546313a7051d59)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:13.172901 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef9388-ec29-4b31-b24e-449eed6f033e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:13.176393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 93/198] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/users/62021fc44d1d46b4bb546313a7051d59 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:13.179424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef9388-ec29-4b31-b24e-449eed6f033e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:13.192227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eab30f-e9dd-4184-908a-e1af63e5e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:13.193270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eab30f-e9dd-4184-908a-e1af63e5e868 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:13.193806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eab30f-e9dd-4184-908a-e1af63e5e868 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:13.194278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eab30f-e9dd-4184-908a-e1af63e5e868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:13.195758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eab30f-e9dd-4184-908a-e1af63e5e868 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=2a63d9b074144aa49bea1d60271c535e, user.id=62021fc44d1d46b4bb546313a7051d59) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:13.196349 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eab30f-e9dd-4184-908a-e1af63e5e868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:13.199255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eab30f-e9dd-4184-908a-e1af63e5e868 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:13.210793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 106/199] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:12 2022] GET /identity/v3/role_assignments?user.id=62021fc44d1d46b4bb546313a7051d59&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:13.212940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eab30f-e9dd-4184-908a-e1af63e5e868 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:13.309790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:13.331103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:13.335619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef9388-ec29-4b31-b24e-449eed6f033e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:13.345011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eab30f-e9dd-4184-908a-e1af63e5e868 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:13.375589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc145e9-f320-4c46-81d2-0d3cb42d4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:13.376845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc145e9-f320-4c46-81d2-0d3cb42d4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:13.377350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc145e9-f320-4c46-81d2-0d3cb42d4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:13.377931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc145e9-f320-4c46-81d2-0d3cb42d4bd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:13.381626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dd4a0-4fb8-4c3e-bd33-34a45b1ae542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:13.382068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd4a0-4fb8-4c3e-bd33-34a45b1ae542 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:13.382354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd4a0-4fb8-4c3e-bd33-34a45b1ae542 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:13.382632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd4a0-4fb8-4c3e-bd33-34a45b1ae542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:13.391501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc145e9-f320-4c46-81d2-0d3cb42d4bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-afc145e9-f320-4c46-81d2-0d3cb42d4bd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:13.400755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:13.401697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:13.402473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:13.404806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 94/200] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:13.410920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc145e9-f320-4c46-81d2-0d3cb42d4bd6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:13.460630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dd4a0-4fb8-4c3e-bd33-34a45b1ae542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:13.462175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dd4a0-4fb8-4c3e-bd33-34a45b1ae542 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:13.535829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc145e9-f320-4c46-81d2-0d3cb42d4bd6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:13.540315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:13.573499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 107/201] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:13.575752 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43975a03-c80c-44bc-adfe-c4a4a90f8743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:13.576608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43975a03-c80c-44bc-adfe-c4a4a90f8743 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:13.577035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43975a03-c80c-44bc-adfe-c4a4a90f8743 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:13.577451 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43975a03-c80c-44bc-adfe-c4a4a90f8743 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:13.578354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43975a03-c80c-44bc-adfe-c4a4a90f8743 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:13.578820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43975a03-c80c-44bc-adfe-c4a4a90f8743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:13.579140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dd4a0-4fb8-4c3e-bd33-34a45b1ae542 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:13.580515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43975a03-c80c-44bc-adfe-c4a4a90f8743 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:13.590608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 95/202] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:13.596254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43975a03-c80c-44bc-adfe-c4a4a90f8743 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:13.623740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:13.683387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dd4a0-4fb8-4c3e-bd33-34a45b1ae542 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:13.710400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43975a03-c80c-44bc-adfe-c4a4a90f8743 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:13.718158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2189-2571-4cce-93b9-73fc39e787a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:13.719347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2189-2571-4cce-93b9-73fc39e787a5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:13.719489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2189-2571-4cce-93b9-73fc39e787a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:13.719737 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2189-2571-4cce-93b9-73fc39e787a5 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:13.720968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2189-2571-4cce-93b9-73fc39e787a5 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:13.722413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2189-2571-4cce-93b9-73fc39e787a5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:13.729005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 108/203] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:13 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:13.730527 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2189-2571-4cce-93b9-73fc39e787a5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:13.749534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a030c0-f5c8-47ba-82be-ff8325cbeae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:13.750754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a030c0-f5c8-47ba-82be-ff8325cbeae3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:13.751184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a030c0-f5c8-47ba-82be-ff8325cbeae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:13.751596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a030c0-f5c8-47ba-82be-ff8325cbeae3 None admin] PATH_INFO: `/v3/users/32c7a15327b54d01ac606dcc00c79984` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:13.753172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a030c0-f5c8-47ba-82be-ff8325cbeae3 None admin] RBAC: Authorizing `identity:get_user(user_id=32c7a15327b54d01ac606dcc00c79984)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:13.754745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a030c0-f5c8-47ba-82be-ff8325cbeae3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:13.757962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 96/204] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:13 2022] GET /identity/v3/users/32c7a15327b54d01ac606dcc00c79984 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:13.764017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a030c0-f5c8-47ba-82be-ff8325cbeae3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:13.774251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:13.874183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2189-2571-4cce-93b9-73fc39e787a5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:13.875033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:13.886596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a030c0-f5c8-47ba-82be-ff8325cbeae3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:13.926067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bfe7b-4e63-4e02-b1f5-617c37cf7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:13.926969 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfe7b-4e63-4e02-b1f5-617c37cf7939 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:13.927396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfe7b-4e63-4e02-b1f5-617c37cf7939 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:13.927970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfe7b-4e63-4e02-b1f5-617c37cf7939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:13.929047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bfe7b-4e63-4e02-b1f5-617c37cf7939 None admin] RBAC: Adding query filter params (role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=2a63d9b074144aa49bea1d60271c535e, user.id=62021fc44d1d46b4bb546313a7051d59) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:13.929766 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bfe7b-4e63-4e02-b1f5-617c37cf7939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:13.931396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bfe7b-4e63-4e02-b1f5-617c37cf7939 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:13.938184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 109/205] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:13 2022] GET /identity/v3/role_assignments?user.id=62021fc44d1d46b4bb546313a7051d59&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:13.955927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cffc36-3b2b-478d-b34d-31c90d0a9d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:13.957168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cffc36-3b2b-478d-b34d-31c90d0a9d6b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:13.957590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cffc36-3b2b-478d-b34d-31c90d0a9d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:13.958024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cffc36-3b2b-478d-b34d-31c90d0a9d6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:14.034140 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cffc36-3b2b-478d-b34d-31c90d0a9d6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:14.035928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cffc36-3b2b-478d-b34d-31c90d0a9d6b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:14.134597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:14.145729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 97/206] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:14.152424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bfe7b-4e63-4e02-b1f5-617c37cf7939 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:14.265714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bfe7b-4e63-4e02-b1f5-617c37cf7939 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:14.267438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:14.304048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b8053-6ae7-4fec-8dda-c13279784a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:14.304929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b8053-6ae7-4fec-8dda-c13279784a28 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:14.305215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b8053-6ae7-4fec-8dda-c13279784a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:14.305497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b8053-6ae7-4fec-8dda-c13279784a28 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:14.306712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b8053-6ae7-4fec-8dda-c13279784a28 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:14.308185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b8053-6ae7-4fec-8dda-c13279784a28 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:14.310207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 110/207] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:14 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:14.315723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cffc36-3b2b-478d-b34d-31c90d0a9d6b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:14.461293 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cffc36-3b2b-478d-b34d-31c90d0a9d6b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:14.518570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f74f87-d340-41cb-a00b-29c0e0d8d0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:14.519143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f74f87-d340-41cb-a00b-29c0e0d8d0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:14.519434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f74f87-d340-41cb-a00b-29c0e0d8d0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:14.519715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f74f87-d340-41cb-a00b-29c0e0d8d0b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:14.520594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f74f87-d340-41cb-a00b-29c0e0d8d0b4 None admin] RBAC: Adding query filter params (role.id=186bf8f58360412bb8ab604514e2c321, scope.project.id=18959bc99d074db3beb4a507e6e95b08, user.id=32c7a15327b54d01ac606dcc00c79984) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:14.520908 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f74f87-d340-41cb-a00b-29c0e0d8d0b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:14.523100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f74f87-d340-41cb-a00b-29c0e0d8d0b4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:14.532851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 98/208] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:14 2022] GET /identity/v3/role_assignments?user.id=32c7a15327b54d01ac606dcc00c79984&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=186bf8f58360412bb8ab604514e2c321 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:15.241105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb12a-8c5c-4dba-aec9-4a238ff6d224 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.242142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb12a-8c5c-4dba-aec9-4a238ff6d224 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.242622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb12a-8c5c-4dba-aec9-4a238ff6d224 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.244251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 111/209] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:15.250374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f2af-cafe-4927-97a4-4afe465a10f9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.251183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f2af-cafe-4927-97a4-4afe465a10f9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.251675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f2af-cafe-4927-97a4-4afe465a10f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.269720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f187f2af-cafe-4927-97a4-4afe465a10f9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:15.271219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f187f2af-cafe-4927-97a4-4afe465a10f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:15.326055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:15.345807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 99/210] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:15.370448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb12a-8c5c-4dba-aec9-4a238ff6d224 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:15.481021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb12a-8c5c-4dba-aec9-4a238ff6d224 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:15.520602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34597f46-ecf7-4beb-a824-e8769f9edd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:15.522953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34597f46-ecf7-4beb-a824-e8769f9edd60 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.523452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34597f46-ecf7-4beb-a824-e8769f9edd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.524016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34597f46-ecf7-4beb-a824-e8769f9edd60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.534799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34597f46-ecf7-4beb-a824-e8769f9edd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-34597f46-ecf7-4beb-a824-e8769f9edd60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:15.543716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:15.544643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:15.545448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:15.548189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 112/211] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:15.554096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187f2af-cafe-4927-97a4-4afe465a10f9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:15.617417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2e982-dd53-4781-b956-75c0a5e53b73 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.618310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2e982-dd53-4781-b956-75c0a5e53b73 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.618799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2e982-dd53-4781-b956-75c0a5e53b73 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.621208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 113/212] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:15.626916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37c6b5-50d1-486e-a316-c1c5daa238e8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.627450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37c6b5-50d1-486e-a316-c1c5daa238e8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.628005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37c6b5-50d1-486e-a316-c1c5daa238e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.647210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ed37c6b5-50d1-486e-a316-c1c5daa238e8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:15.649267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ed37c6b5-50d1-486e-a316-c1c5daa238e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:15.667865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187f2af-cafe-4927-97a4-4afe465a10f9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:15.675179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:15.707278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77890-77f5-4c2e-8cc9-e993f0a65a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:15.708114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77890-77f5-4c2e-8cc9-e993f0a65a75 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.708398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77890-77f5-4c2e-8cc9-e993f0a65a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.708688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77890-77f5-4c2e-8cc9-e993f0a65a75 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.709971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f77890-77f5-4c2e-8cc9-e993f0a65a75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:15.710376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f77890-77f5-4c2e-8cc9-e993f0a65a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:15.711873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f77890-77f5-4c2e-8cc9-e993f0a65a75 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:15.720445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 100/213] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:15.721690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f86bd-d28a-4570-b93e-500081f14a47 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.721985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f86bd-d28a-4570-b93e-500081f14a47 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.722268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f86bd-d28a-4570-b93e-500081f14a47 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.723669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 101/214] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:15.724784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 114/215] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:15.726263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f86bd-d28a-4570-b93e-500081f14a47 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:15.733631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c60f4-c0de-4022-be20-085d82f4c28b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.733922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c60f4-c0de-4022-be20-085d82f4c28b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.734202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c60f4-c0de-4022-be20-085d82f4c28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.758968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a31c60f4-c0de-4022-be20-085d82f4c28b None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:15.760193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a31c60f4-c0de-4022-be20-085d82f4c28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:15.781042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:15.828854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 115/216] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:15.829693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c60f4-c0de-4022-be20-085d82f4c28b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:15.844373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f86bd-d28a-4570-b93e-500081f14a47 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:15.883847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bb776-4881-4928-8aee-8f962a1b7ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:15.885151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bb776-4881-4928-8aee-8f962a1b7ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.885676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bb776-4881-4928-8aee-8f962a1b7ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.886054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bb776-4881-4928-8aee-8f962a1b7ec3 None admin] PATH_INFO: `/v3/users/569dae02eb4549bfa5c0d125acebeacb` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.900755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bb776-4881-4928-8aee-8f962a1b7ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=569dae02eb4549bfa5c0d125acebeacb)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:15.902380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bb776-4881-4928-8aee-8f962a1b7ec3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:15.908957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 102/217] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:15 2022] GET /identity/v3/users/569dae02eb4549bfa5c0d125acebeacb => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:15.908957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bb776-4881-4928-8aee-8f962a1b7ec3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:15.939841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:15.950917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c60f4-c0de-4022-be20-085d82f4c28b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:15.988993 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e6158-8c58-4d8b-a317-f71098373ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:15.989790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e6158-8c58-4d8b-a317-f71098373ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:15.990076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e6158-8c58-4d8b-a317-f71098373ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:15.990625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e6158-8c58-4d8b-a317-f71098373ef5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:15.991867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e6158-8c58-4d8b-a317-f71098373ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:15.993367 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e6158-8c58-4d8b-a317-f71098373ef5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:15.995011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 116/218] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:15.997104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e6158-8c58-4d8b-a317-f71098373ef5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:16.018625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bb776-4881-4928-8aee-8f962a1b7ec3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:16.021708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:16.061137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb4c1f-7373-4cad-98f7-de6c2a109273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:16.061930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4c1f-7373-4cad-98f7-de6c2a109273 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.062212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4c1f-7373-4cad-98f7-de6c2a109273 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.062494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4c1f-7373-4cad-98f7-de6c2a109273 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.073398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb4c1f-7373-4cad-98f7-de6c2a109273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-98eb4c1f-7373-4cad-98f7-de6c2a109273 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:16.081600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:16.082513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 103/219] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:16.084361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb4c1f-7373-4cad-98f7-de6c2a109273 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:16.122203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e6158-8c58-4d8b-a317-f71098373ef5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:16.165926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32c593-e5fb-4c79-975c-bae3fc300319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:16.166620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32c593-e5fb-4c79-975c-bae3fc300319 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.166910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32c593-e5fb-4c79-975c-bae3fc300319 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.167196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32c593-e5fb-4c79-975c-bae3fc300319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.192475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb4c1f-7373-4cad-98f7-de6c2a109273 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:16.197360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:16.227644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c4cc-c927-4a56-837f-14ab6e80d7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:16.228339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c4cc-c927-4a56-837f-14ab6e80d7fc None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.228622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c4cc-c927-4a56-837f-14ab6e80d7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.228898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c4cc-c927-4a56-837f-14ab6e80d7fc None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.229727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c4cc-c927-4a56-837f-14ab6e80d7fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:16.231271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c4cc-c927-4a56-837f-14ab6e80d7fc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:16.243843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32c593-e5fb-4c79-975c-bae3fc300319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:16.245486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32c593-e5fb-4c79-975c-bae3fc300319 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:16.257676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 104/220] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:16 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:16.258307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c4cc-c927-4a56-837f-14ab6e80d7fc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:16.291202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:16.398469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 117/221] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:16.404110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32c593-e5fb-4c79-975c-bae3fc300319 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:16.404437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c4cc-c927-4a56-837f-14ab6e80d7fc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:16.447566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f968ebf-2d9e-4f98-b492-a0e5a196db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:16.448345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968ebf-2d9e-4f98-b492-a0e5a196db0b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.448630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968ebf-2d9e-4f98-b492-a0e5a196db0b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.448955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968ebf-2d9e-4f98-b492-a0e5a196db0b None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.449842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f968ebf-2d9e-4f98-b492-a0e5a196db0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:16.450161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f968ebf-2d9e-4f98-b492-a0e5a196db0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:16.451531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f968ebf-2d9e-4f98-b492-a0e5a196db0b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:16.462524 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 105/222] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:16.463841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d391b-06a4-48c1-9666-767c89a6413a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.464181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d391b-06a4-48c1-9666-767c89a6413a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.464460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d391b-06a4-48c1-9666-767c89a6413a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.465836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 106/223] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:16.469234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d391b-06a4-48c1-9666-767c89a6413a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:16.482064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:16.538304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32c593-e5fb-4c79-975c-bae3fc300319 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:16.579612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:16.583595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43b78b-3c2b-4377-ad78-96f98647eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:16.585283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b78b-3c2b-4377-ad78-96f98647eb44 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.585604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b78b-3c2b-4377-ad78-96f98647eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.585834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b78b-3c2b-4377-ad78-96f98647eb44 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.587100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43b78b-3c2b-4377-ad78-96f98647eb44 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:16.588807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43b78b-3c2b-4377-ad78-96f98647eb44 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:16.591341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 118/224] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:16 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:16.592073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654233f8-952c-48e3-9c70-54c817b8c185 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.592369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654233f8-952c-48e3-9c70-54c817b8c185 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.592569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654233f8-952c-48e3-9c70-54c817b8c185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.605567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d391b-06a4-48c1-9666-767c89a6413a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:16.609215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-654233f8-952c-48e3-9c70-54c817b8c185 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:16.610417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-654233f8-952c-48e3-9c70-54c817b8c185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:16.642870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ad88f-da3a-417b-abee-ddd343b71982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:16.643753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ad88f-da3a-417b-abee-ddd343b71982 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.644069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ad88f-da3a-417b-abee-ddd343b71982 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.644349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ad88f-da3a-417b-abee-ddd343b71982 None admin] PATH_INFO: `/v3/users/62021fc44d1d46b4bb546313a7051d59` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.648922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ad88f-da3a-417b-abee-ddd343b71982 None admin] RBAC: Authorizing `identity:get_user(user_id=62021fc44d1d46b4bb546313a7051d59)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:16.650895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ad88f-da3a-417b-abee-ddd343b71982 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:16.654090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 107/225] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:16 2022] GET /identity/v3/users/62021fc44d1d46b4bb546313a7051d59 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:16.655123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ad88f-da3a-417b-abee-ddd343b71982 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:16.691038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 119/226] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:16.691979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654233f8-952c-48e3-9c70-54c817b8c185 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:16.773573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:16.783829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ad88f-da3a-417b-abee-ddd343b71982 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:16.820794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654233f8-952c-48e3-9c70-54c817b8c185 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:16.829915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95bb89-11c2-490f-bebe-a7f631634898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:16.830617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95bb89-11c2-490f-bebe-a7f631634898 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.831333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95bb89-11c2-490f-bebe-a7f631634898 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.831614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95bb89-11c2-490f-bebe-a7f631634898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.832900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95bb89-11c2-490f-bebe-a7f631634898 None admin] RBAC: Adding query filter params (role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=2a63d9b074144aa49bea1d60271c535e, user.id=569dae02eb4549bfa5c0d125acebeacb) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:16.833222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95bb89-11c2-490f-bebe-a7f631634898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:16.835301 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95bb89-11c2-490f-bebe-a7f631634898 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:16.842855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 108/227] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:16 2022] GET /identity/v3/role_assignments?user.id=569dae02eb4549bfa5c0d125acebeacb&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:16.848973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95bb89-11c2-490f-bebe-a7f631634898 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:16.878914 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd53b8-b5f2-4a57-a768-1a2c9d7a0dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:16.879861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd53b8-b5f2-4a57-a768-1a2c9d7a0dcf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:16.880266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:16.880411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd53b8-b5f2-4a57-a768-1a2c9d7a0dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:16.880594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd53b8-b5f2-4a57-a768-1a2c9d7a0dcf None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:16.883189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd53b8-b5f2-4a57-a768-1a2c9d7a0dcf None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:16.884276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd53b8-b5f2-4a57-a768-1a2c9d7a0dcf None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:16.886162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 120/228] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:16 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:16.892521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd53b8-b5f2-4a57-a768-1a2c9d7a0dcf None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:17.007473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd53b8-b5f2-4a57-a768-1a2c9d7a0dcf None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:17.034087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:17.045913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d110766-c39a-48c1-8af5-4f5d7ab1cc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:17.046825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d110766-c39a-48c1-8af5-4f5d7ab1cc3c None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:17.047119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d110766-c39a-48c1-8af5-4f5d7ab1cc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:17.047404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d110766-c39a-48c1-8af5-4f5d7ab1cc3c None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e/users/62021fc44d1d46b4bb546313a7051d59/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:17.049613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d110766-c39a-48c1-8af5-4f5d7ab1cc3c None admin] RBAC: Authorizing `identity:create_grant(project_id=2a63d9b074144aa49bea1d60271c535e, user_id=62021fc44d1d46b4bb546313a7051d59, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:17.050893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d110766-c39a-48c1-8af5-4f5d7ab1cc3c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:17.072136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 121/229] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:58:16 2022] PUT /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e/users/62021fc44d1d46b4bb546313a7051d59/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:17.088567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95bb89-11c2-490f-bebe-a7f631634898 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:17.130095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37f56-1091-4b11-83e2-9b743dafbc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:17.131003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37f56-1091-4b11-83e2-9b743dafbc84 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:17.131289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37f56-1091-4b11-83e2-9b743dafbc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:17.131576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37f56-1091-4b11-83e2-9b743dafbc84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:17.153260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf37f56-1091-4b11-83e2-9b743dafbc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-edf37f56-1091-4b11-83e2-9b743dafbc84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:17.161760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:17.163102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:17.163885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 109/230] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:17.169421 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d110766-c39a-48c1-8af5-4f5d7ab1cc3c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:17.322080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d110766-c39a-48c1-8af5-4f5d7ab1cc3c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:17.360756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65613-5d38-4301-bff0-31d6d4100bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:17.361435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65613-5d38-4301-bff0-31d6d4100bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:17.361720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65613-5d38-4301-bff0-31d6d4100bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:17.361997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65613-5d38-4301-bff0-31d6d4100bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:17.362822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e65613-5d38-4301-bff0-31d6d4100bc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:17.363134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e65613-5d38-4301-bff0-31d6d4100bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:17.364587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e65613-5d38-4301-bff0-31d6d4100bc7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:17.374226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 122/231] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:17.379985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37f56-1091-4b11-83e2-9b743dafbc84 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:17.507079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:17.546753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37f56-1091-4b11-83e2-9b743dafbc84 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:17.591726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcd016-1295-414c-9699-eb2722b2bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:17.592559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd016-1295-414c-9699-eb2722b2bf61 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:17.592845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd016-1295-414c-9699-eb2722b2bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:17.593124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd016-1295-414c-9699-eb2722b2bf61 None admin] PATH_INFO: `/v3/users/62021fc44d1d46b4bb546313a7051d59` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:17.596625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcd016-1295-414c-9699-eb2722b2bf61 None admin] RBAC: Authorizing `identity:get_user(user_id=62021fc44d1d46b4bb546313a7051d59)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:17.598165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcd016-1295-414c-9699-eb2722b2bf61 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:17.599968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 110/232] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:17 2022] GET /identity/v3/users/62021fc44d1d46b4bb546313a7051d59 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:17.605669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65613-5d38-4301-bff0-31d6d4100bc7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:17.665801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:17.730504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65613-5d38-4301-bff0-31d6d4100bc7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:17.775808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6570e-1dbc-4876-824d-0736774365ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:17.777106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6570e-1dbc-4876-824d-0736774365ea None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:17.777595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6570e-1dbc-4876-824d-0736774365ea None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:17.778086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6570e-1dbc-4876-824d-0736774365ea None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:17.780699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6570e-1dbc-4876-824d-0736774365ea None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:17.782201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6570e-1dbc-4876-824d-0736774365ea None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:17.783980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 123/233] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:17 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:17.790268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcd016-1295-414c-9699-eb2722b2bf61 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:17.975527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcd016-1295-414c-9699-eb2722b2bf61 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:18.021830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45e2fc-e32b-4f5a-8975-e98f2da7e4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:18.022773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45e2fc-e32b-4f5a-8975-e98f2da7e4bb None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:18.023062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45e2fc-e32b-4f5a-8975-e98f2da7e4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:18.023337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45e2fc-e32b-4f5a-8975-e98f2da7e4bb None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e/users/62021fc44d1d46b4bb546313a7051d59/roles/61fdd4e4d3c546ec97b97285ad1f80cd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:18.025658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45e2fc-e32b-4f5a-8975-e98f2da7e4bb None admin] RBAC: Authorizing `identity:create_grant(project_id=2a63d9b074144aa49bea1d60271c535e, user_id=62021fc44d1d46b4bb546313a7051d59, role_id=61fdd4e4d3c546ec97b97285ad1f80cd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:18.027117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45e2fc-e32b-4f5a-8975-e98f2da7e4bb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:18.060640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 111/234] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:58:17 2022] PUT /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e/users/62021fc44d1d46b4bb546313a7051d59/roles/61fdd4e4d3c546ec97b97285ad1f80cd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:18.887778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d84f2-851e-4a5c-95ad-157b23995400 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:18.888348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d84f2-851e-4a5c-95ad-157b23995400 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:18.888348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d84f2-851e-4a5c-95ad-157b23995400 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:18.889747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 124/235] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:18.901311 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9e160-84ac-4174-ba2a-a86bb6f131ed None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:18.902708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61031f7f-b8d8-464d-b432-298dfc503596 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:18.902998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61031f7f-b8d8-464d-b432-298dfc503596 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:18.903279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61031f7f-b8d8-464d-b432-298dfc503596 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:18.904623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 125/236] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:58:18.904835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9e160-84ac-4174-ba2a-a86bb6f131ed None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:18.905116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9e160-84ac-4174-ba2a-a86bb6f131ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:18.910188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:18.911457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecb8fd-302c-4f25-a2ce-6d1bc20da12c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:18.911744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecb8fd-302c-4f25-a2ce-6d1bc20da12c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:18.912125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecb8fd-302c-4f25-a2ce-6d1bc20da12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:18.936021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e3ecb8fd-302c-4f25-a2ce-6d1bc20da12c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:18.937235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e3ecb8fd-302c-4f25-a2ce-6d1bc20da12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:18.943354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-98d9e160-84ac-4174-ba2a-a86bb6f131ed None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:18.946773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-98d9e160-84ac-4174-ba2a-a86bb6f131ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:19.063341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 126/237] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:19.072190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 112/238] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:19.094212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecb8fd-302c-4f25-a2ce-6d1bc20da12c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:19.122120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9e160-84ac-4174-ba2a-a86bb6f131ed None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:19.187549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:19.255407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9e160-84ac-4174-ba2a-a86bb6f131ed None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:19.278232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecb8fd-302c-4f25-a2ce-6d1bc20da12c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:19.289987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:19.296541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdb6a9-200b-49d5-9704-6307ef726328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:19.297350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdb6a9-200b-49d5-9704-6307ef726328 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.297638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdb6a9-200b-49d5-9704-6307ef726328 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.297915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdb6a9-200b-49d5-9704-6307ef726328 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.299202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdb6a9-200b-49d5-9704-6307ef726328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:19.300672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdb6a9-200b-49d5-9704-6307ef726328 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:19.302325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 113/239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:19.310860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdb6a9-200b-49d5-9704-6307ef726328 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:19.346074 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eb1db-9948-476d-a981-7ab93fefbb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:19.347359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eb1db-9948-476d-a981-7ab93fefbb7a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.347841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eb1db-9948-476d-a981-7ab93fefbb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.348513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eb1db-9948-476d-a981-7ab93fefbb7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.368558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00eb1db-9948-476d-a981-7ab93fefbb7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c00eb1db-9948-476d-a981-7ab93fefbb7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:19.383271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:19.384240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:19.385045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:19.388456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 127/240] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:19.394207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eb1db-9948-476d-a981-7ab93fefbb7a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:19.428924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdb6a9-200b-49d5-9704-6307ef726328 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:19.463676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3354c9-9a2b-4484-95c9-d2ec1053bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:19.464401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3354c9-9a2b-4484-95c9-d2ec1053bb8e None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.464601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3354c9-9a2b-4484-95c9-d2ec1053bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.464883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3354c9-9a2b-4484-95c9-d2ec1053bb8e None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.465639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3354c9-9a2b-4484-95c9-d2ec1053bb8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:19.467132 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3354c9-9a2b-4484-95c9-d2ec1053bb8e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:19.499315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 114/241] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:19 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:19.504914 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23978d9-e927-4d45-a567-d9ec1d3524b0 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.505213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23978d9-e927-4d45-a567-d9ec1d3524b0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.507921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23978d9-e927-4d45-a567-d9ec1d3524b0 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.512732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 115/242] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:19.522628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eb1db-9948-476d-a981-7ab93fefbb7a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:19.525518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:19.526177 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad787425-9af0-42a8-afc8-c2658a4a846e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.526493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad787425-9af0-42a8-afc8-c2658a4a846e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.526863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad787425-9af0-42a8-afc8-c2658a4a846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.565100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ad787425-9af0-42a8-afc8-c2658a4a846e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:19.566348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ad787425-9af0-42a8-afc8-c2658a4a846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:19.591745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78351a-7252-4fc2-b5dc-67d351e0dde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:19.592588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78351a-7252-4fc2-b5dc-67d351e0dde1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.592933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78351a-7252-4fc2-b5dc-67d351e0dde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.593144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78351a-7252-4fc2-b5dc-67d351e0dde1 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.593934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78351a-7252-4fc2-b5dc-67d351e0dde1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:19.594248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78351a-7252-4fc2-b5dc-67d351e0dde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:19.595693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78351a-7252-4fc2-b5dc-67d351e0dde1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:19.618978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 128/243] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:19.625665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78351a-7252-4fc2-b5dc-67d351e0dde1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:19.668415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:19.698841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 116/244] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:19.724619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad787425-9af0-42a8-afc8-c2658a4a846e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:19.748369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78351a-7252-4fc2-b5dc-67d351e0dde1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:19.785919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621ecb5-6f1d-44d3-99fb-5f781dbc3dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:19.787354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621ecb5-6f1d-44d3-99fb-5f781dbc3dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.787630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621ecb5-6f1d-44d3-99fb-5f781dbc3dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.788787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621ecb5-6f1d-44d3-99fb-5f781dbc3dd3 None admin] PATH_INFO: `/v3/users/3d3782fd69a44cde8f05f5342f1c4ca4` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.807971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621ecb5-6f1d-44d3-99fb-5f781dbc3dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=3d3782fd69a44cde8f05f5342f1c4ca4)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:19.809501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621ecb5-6f1d-44d3-99fb-5f781dbc3dd3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:19.811292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 129/245] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:19 2022] GET /identity/v3/users/3d3782fd69a44cde8f05f5342f1c4ca4 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:19.813239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f49d-c9cd-4ed4-987e-4ba1ca95829e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.813534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f49d-c9cd-4ed4-987e-4ba1ca95829e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.813816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f49d-c9cd-4ed4-987e-4ba1ca95829e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.815092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 130/246] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:19.817915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561f49d-c9cd-4ed4-987e-4ba1ca95829e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:19.857117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad787425-9af0-42a8-afc8-c2658a4a846e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:19.862443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:19.905959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2c8b2-b73b-4c6f-95d8-1046c34c4f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:19.906771 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2c8b2-b73b-4c6f-95d8-1046c34c4f22 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.907062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2c8b2-b73b-4c6f-95d8-1046c34c4f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.907681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2c8b2-b73b-4c6f-95d8-1046c34c4f22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.923508 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2c8b2-b73b-4c6f-95d8-1046c34c4f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-77d2c8b2-b73b-4c6f-95d8-1046c34c4f22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:19.932295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:19.933187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:19.934699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 117/247] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:19.935375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c61bc-ee97-42ce-bc80-b25856c41916 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:19.935375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c61bc-ee97-42ce-bc80-b25856c41916 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:19.935676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c61bc-ee97-42ce-bc80-b25856c41916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:19.954447 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-dd4c61bc-ee97-42ce-bc80-b25856c41916 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:19.955875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-dd4c61bc-ee97-42ce-bc80-b25856c41916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:19.972399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561f49d-c9cd-4ed4-987e-4ba1ca95829e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:20.012399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:20.024243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b377ec6-55a4-4b53-9a1e-663d7404c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:20.025211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377ec6-55a4-4b53-9a1e-663d7404c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:20.025501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377ec6-55a4-4b53-9a1e-663d7404c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:20.025779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377ec6-55a4-4b53-9a1e-663d7404c2c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:20.050296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 118/248] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:20.051217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c61bc-ee97-42ce-bc80-b25856c41916 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:20.116098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b377ec6-55a4-4b53-9a1e-663d7404c2c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:20.118037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b377ec6-55a4-4b53-9a1e-663d7404c2c4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:20.180893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:20.211196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c61bc-ee97-42ce-bc80-b25856c41916 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:20.290548 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 131/249] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:20.291308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b377ec6-55a4-4b53-9a1e-663d7404c2c4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:20.291672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7db5d9-632a-488e-91ea-27b6a31bc49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:20.292609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7db5d9-632a-488e-91ea-27b6a31bc49c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:20.293130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7db5d9-632a-488e-91ea-27b6a31bc49c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:20.293611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7db5d9-632a-488e-91ea-27b6a31bc49c None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:20.294569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7db5d9-632a-488e-91ea-27b6a31bc49c None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:20.295082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7db5d9-632a-488e-91ea-27b6a31bc49c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:20.304813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7db5d9-632a-488e-91ea-27b6a31bc49c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:20.323944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 119/250] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:20.325264 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7db5d9-632a-488e-91ea-27b6a31bc49c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:20.390494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:20.399657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b377ec6-55a4-4b53-9a1e-663d7404c2c4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:20.428529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:20.442427 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d936ec4-1d02-4da7-b1cb-52cedaddf0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:20.444128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d936ec4-1d02-4da7-b1cb-52cedaddf0bb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:20.444806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d936ec4-1d02-4da7-b1cb-52cedaddf0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:20.446064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d936ec4-1d02-4da7-b1cb-52cedaddf0bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:20.468139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d936ec4-1d02-4da7-b1cb-52cedaddf0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-3d936ec4-1d02-4da7-b1cb-52cedaddf0bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:20.476588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:20.477448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:20.478266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:20.486229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 132/251] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:20.487278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d936ec4-1d02-4da7-b1cb-52cedaddf0bb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:20.503407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7db5d9-632a-488e-91ea-27b6a31bc49c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:20.549040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034e37b-5ba0-4bca-80ee-ba985b798f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:20.549844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034e37b-5ba0-4bca-80ee-ba985b798f13 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:20.550130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034e37b-5ba0-4bca-80ee-ba985b798f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:20.550409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034e37b-5ba0-4bca-80ee-ba985b798f13 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:20.551658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034e37b-5ba0-4bca-80ee-ba985b798f13 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:20.553246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034e37b-5ba0-4bca-80ee-ba985b798f13 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:20.560111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 120/252] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:20 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:20.562859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79fc35-9869-4595-a913-a6c74092e5dc None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:20.563358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79fc35-9869-4595-a913-a6c74092e5dc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:20.563639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79fc35-9869-4595-a913-a6c74092e5dc None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:20.564994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 121/253] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:20.566307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79fc35-9869-4595-a913-a6c74092e5dc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:20.612545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d936ec4-1d02-4da7-b1cb-52cedaddf0bb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:20.654999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f5dd7-085a-4f05-860f-6fd00a53934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:20.656175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f5dd7-085a-4f05-860f-6fd00a53934e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:20.656467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f5dd7-085a-4f05-860f-6fd00a53934e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:20.657361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f5dd7-085a-4f05-860f-6fd00a53934e None admin] PATH_INFO: `/v3/users/569dae02eb4549bfa5c0d125acebeacb` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:20.658873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f5dd7-085a-4f05-860f-6fd00a53934e None admin] RBAC: Authorizing `identity:get_user(user_id=569dae02eb4549bfa5c0d125acebeacb)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:20.661507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f5dd7-085a-4f05-860f-6fd00a53934e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:20.663467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 133/254] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:20 2022] GET /identity/v3/users/569dae02eb4549bfa5c0d125acebeacb => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:20.668104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f5dd7-085a-4f05-860f-6fd00a53934e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:20.704056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79fc35-9869-4595-a913-a6c74092e5dc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:20.716009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:20.736617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:20.753288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cde33e-ef37-4589-a9b9-27cf1b4ec3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:20.754375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde33e-ef37-4589-a9b9-27cf1b4ec3cc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:20.754983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde33e-ef37-4589-a9b9-27cf1b4ec3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:20.755429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde33e-ef37-4589-a9b9-27cf1b4ec3cc None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:20.756974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cde33e-ef37-4589-a9b9-27cf1b4ec3cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:20.757477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cde33e-ef37-4589-a9b9-27cf1b4ec3cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:20.759039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cde33e-ef37-4589-a9b9-27cf1b4ec3cc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:20.768634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 122/255] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:20.770166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2f927-d107-49cf-912d-47fe6dd53929 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:20.770638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2f927-d107-49cf-912d-47fe6dd53929 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:20.771121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2f927-d107-49cf-912d-47fe6dd53929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:20.790433 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1ab2f927-d107-49cf-912d-47fe6dd53929 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:20.791958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1ab2f927-d107-49cf-912d-47fe6dd53929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:20.792577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f5dd7-085a-4f05-860f-6fd00a53934e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:20.827612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ff6da-48a3-4539-a35d-7f0f0d3404d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:20.828280 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ff6da-48a3-4539-a35d-7f0f0d3404d8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:20.828584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ff6da-48a3-4539-a35d-7f0f0d3404d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:20.828908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ff6da-48a3-4539-a35d-7f0f0d3404d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:20.829821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ff6da-48a3-4539-a35d-7f0f0d3404d8 None admin] RBAC: Adding query filter params (role.id=186bf8f58360412bb8ab604514e2c321, scope.project.id=2a63d9b074144aa49bea1d60271c535e, user.id=3d3782fd69a44cde8f05f5342f1c4ca4) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:20.830142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ff6da-48a3-4539-a35d-7f0f0d3404d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:20.831843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ff6da-48a3-4539-a35d-7f0f0d3404d8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:20.838710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 134/256] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:20 2022] GET /identity/v3/role_assignments?user.id=3d3782fd69a44cde8f05f5342f1c4ca4&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=186bf8f58360412bb8ab604514e2c321 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:20.839507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ff6da-48a3-4539-a35d-7f0f0d3404d8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:20.873627 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 123/257] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:20.875010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2f927-d107-49cf-912d-47fe6dd53929 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:20.968597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ff6da-48a3-4539-a35d-7f0f0d3404d8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:20.993617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:21.000854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2f927-d107-49cf-912d-47fe6dd53929 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:21.015165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:21.062295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edabdb-d427-45aa-a920-a0732d2f9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:21.063185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be9a32-d997-4d78-b2a1-144cacf2464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:21.063380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edabdb-d427-45aa-a920-a0732d2f9401 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:21.063614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edabdb-d427-45aa-a920-a0732d2f9401 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:21.063910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edabdb-d427-45aa-a920-a0732d2f9401 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:21.064101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be9a32-d997-4d78-b2a1-144cacf2464f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:21.064399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be9a32-d997-4d78-b2a1-144cacf2464f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:21.064786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be9a32-d997-4d78-b2a1-144cacf2464f None admin] PATH_INFO: `/v3/users/62021fc44d1d46b4bb546313a7051d59` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:21.066017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be9a32-d997-4d78-b2a1-144cacf2464f None admin] RBAC: Authorizing `identity:get_user(user_id=62021fc44d1d46b4bb546313a7051d59)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:21.066133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edabdb-d427-45aa-a920-a0732d2f9401 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:21.067496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be9a32-d997-4d78-b2a1-144cacf2464f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:21.067604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edabdb-d427-45aa-a920-a0732d2f9401 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:21.069387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 124/258] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:20 2022] GET /identity/v3/users/62021fc44d1d46b4bb546313a7051d59 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:21.069788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 135/259] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:20 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:21.070453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be9a32-d997-4d78-b2a1-144cacf2464f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:21.076893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edabdb-d427-45aa-a920-a0732d2f9401 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:21.231621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be9a32-d997-4d78-b2a1-144cacf2464f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:21.286474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d071f18-1a71-4cd2-9e28-afbbae4456ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:21.287526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d071f18-1a71-4cd2-9e28-afbbae4456ef None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:21.287814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d071f18-1a71-4cd2-9e28-afbbae4456ef None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:21.288160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d071f18-1a71-4cd2-9e28-afbbae4456ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:21.289443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edabdb-d427-45aa-a920-a0732d2f9401 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:21.300226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d071f18-1a71-4cd2-9e28-afbbae4456ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4d071f18-1a71-4cd2-9e28-afbbae4456ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:21.309258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:21.310189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 125/260] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:21.311473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d071f18-1a71-4cd2-9e28-afbbae4456ef None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:21.357567 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925c764-1b47-476f-bf61-e850674d736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:21.358694 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925c764-1b47-476f-bf61-e850674d736c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:21.359187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925c764-1b47-476f-bf61-e850674d736c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:21.359663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925c764-1b47-476f-bf61-e850674d736c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:21.366423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:21.467110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:21.469606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d071f18-1a71-4cd2-9e28-afbbae4456ef None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:21.511745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925c764-1b47-476f-bf61-e850674d736c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:21.513501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925c764-1b47-476f-bf61-e850674d736c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:21.528080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10084c9c-ca18-4c4f-9254-034659a3b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:21.528280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10084c9c-ca18-4c4f-9254-034659a3b0b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:21.528542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10084c9c-ca18-4c4f-9254-034659a3b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:21.528731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10084c9c-ca18-4c4f-9254-034659a3b0b8 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e/users/569dae02eb4549bfa5c0d125acebeacb/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:21.531567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10084c9c-ca18-4c4f-9254-034659a3b0b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a63d9b074144aa49bea1d60271c535e, user_id=569dae02eb4549bfa5c0d125acebeacb, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:21.533094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10084c9c-ca18-4c4f-9254-034659a3b0b8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:21.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 126/261] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:58:21 2022] PUT /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e/users/569dae02eb4549bfa5c0d125acebeacb/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:21.555933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10084c9c-ca18-4c4f-9254-034659a3b0b8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:21.709756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:21.719640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10084c9c-ca18-4c4f-9254-034659a3b0b8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:21.762724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea972-1572-4805-9a8b-35d7beaf91bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:21.763525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea972-1572-4805-9a8b-35d7beaf91bb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:21.763814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea972-1572-4805-9a8b-35d7beaf91bb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:21.764124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea972-1572-4805-9a8b-35d7beaf91bb None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:21.764968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ea972-1572-4805-9a8b-35d7beaf91bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:21.765280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ea972-1572-4805-9a8b-35d7beaf91bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:21.766790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ea972-1572-4805-9a8b-35d7beaf91bb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:21.781419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 127/262] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:21.782950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea972-1572-4805-9a8b-35d7beaf91bb None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:21.790415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 136/263] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:21.796411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925c764-1b47-476f-bf61-e850674d736c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:21.894462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea972-1572-4805-9a8b-35d7beaf91bb None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:21.931063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec462b-9220-4f6a-96ed-e1dc8bdd5810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:21.931972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec462b-9220-4f6a-96ed-e1dc8bdd5810 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:21.932260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec462b-9220-4f6a-96ed-e1dc8bdd5810 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:21.932537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec462b-9220-4f6a-96ed-e1dc8bdd5810 None admin] PATH_INFO: `/v3/users/62021fc44d1d46b4bb546313a7051d59` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:21.933747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec462b-9220-4f6a-96ed-e1dc8bdd5810 None admin] RBAC: Authorizing `identity:get_user(user_id=62021fc44d1d46b4bb546313a7051d59)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:21.935262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec462b-9220-4f6a-96ed-e1dc8bdd5810 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:21.941482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 128/264] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:21 2022] GET /identity/v3/users/62021fc44d1d46b4bb546313a7051d59 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:21.942712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec462b-9220-4f6a-96ed-e1dc8bdd5810 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:21.962235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:22.000285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:22.042263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925c764-1b47-476f-bf61-e850674d736c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:22.050957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec462b-9220-4f6a-96ed-e1dc8bdd5810 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:22.088055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9ec73-754f-4de6-a453-faa61ba6e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:22.088727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9ec73-754f-4de6-a453-faa61ba6e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.089015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9ec73-754f-4de6-a453-faa61ba6e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.089295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9ec73-754f-4de6-a453-faa61ba6e7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:22.133043 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30157477-4670-4fcd-ae8b-c4be62c57db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:22.133974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30157477-4670-4fcd-ae8b-c4be62c57db6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.134271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30157477-4670-4fcd-ae8b-c4be62c57db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.134560 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30157477-4670-4fcd-ae8b-c4be62c57db6 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:22.135783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30157477-4670-4fcd-ae8b-c4be62c57db6 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:22.137274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30157477-4670-4fcd-ae8b-c4be62c57db6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:22.139373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 137/265] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:21 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:22.145199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30157477-4670-4fcd-ae8b-c4be62c57db6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:22.173096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9ec73-754f-4de6-a453-faa61ba6e7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:22.174561 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9ec73-754f-4de6-a453-faa61ba6e7a2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:22.192655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:22.285304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 129/266] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 21:58:22.287248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851477-4c7d-4529-9e74-a8c36e066444 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.287543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851477-4c7d-4529-9e74-a8c36e066444 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.287824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851477-4c7d-4529-9e74-a8c36e066444 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:22.289192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 130/267] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:22.290320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a851477-4c7d-4529-9e74-a8c36e066444 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:22.398509 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a851477-4c7d-4529-9e74-a8c36e066444 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:22.416190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:22.417401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30157477-4670-4fcd-ae8b-c4be62c57db6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:22.437371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae2ff-c12f-427e-a706-6edaa2ab9eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:22.438251 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae2ff-c12f-427e-a706-6edaa2ab9eec None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.438535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae2ff-c12f-427e-a706-6edaa2ab9eec None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.438814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae2ff-c12f-427e-a706-6edaa2ab9eec None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:22.440040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae2ff-c12f-427e-a706-6edaa2ab9eec None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:22.441625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae2ff-c12f-427e-a706-6edaa2ab9eec None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:22.448006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 131/268] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:22 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:22.449291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e92c-d4da-48f4-8b3a-1eb53ff1fecc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.449584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e92c-d4da-48f4-8b3a-1eb53ff1fecc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.449983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e92c-d4da-48f4-8b3a-1eb53ff1fecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:22.468663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3984e92c-d4da-48f4-8b3a-1eb53ff1fecc None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:22.469989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3984e92c-d4da-48f4-8b3a-1eb53ff1fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:22.528657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e7243-12a2-45d2-90e4-56ec0c687c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:22.529340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7243-12a2-45d2-90e4-56ec0c687c29 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.529633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7243-12a2-45d2-90e4-56ec0c687c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.529915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7243-12a2-45d2-90e4-56ec0c687c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:22.530771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e7243-12a2-45d2-90e4-56ec0c687c29 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=2a63d9b074144aa49bea1d60271c535e, user.id=62021fc44d1d46b4bb546313a7051d59) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:22.531088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e7243-12a2-45d2-90e4-56ec0c687c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:22.532619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e7243-12a2-45d2-90e4-56ec0c687c29 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:22.542648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 138/269] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:22 2022] GET /identity/v3/role_assignments?user.id=62021fc44d1d46b4bb546313a7051d59&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 608 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:22.543410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e7243-12a2-45d2-90e4-56ec0c687c29 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:22.563172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 132/270] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:22.571265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc5da7-f5f4-4693-ac77-c8ee225a1404 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.571563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc5da7-f5f4-4693-ac77-c8ee225a1404 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.571847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc5da7-f5f4-4693-ac77-c8ee225a1404 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:22.573682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 133/271] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:58:22.579040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd5eb1-044f-4cd3-adb8-7c55b85682cd None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.579339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd5eb1-044f-4cd3-adb8-7c55b85682cd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.579623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd5eb1-044f-4cd3-adb8-7c55b85682cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:22.585960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:22.598824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-27cd5eb1-044f-4cd3-adb8-7c55b85682cd None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:22.600894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-27cd5eb1-044f-4cd3-adb8-7c55b85682cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:22.730839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e7243-12a2-45d2-90e4-56ec0c687c29 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:22.733801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 134/272] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:22.734901 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd5eb1-044f-4cd3-adb8-7c55b85682cd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:22.801840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa2388-a0d5-4838-8004-15f5341267c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:22.802711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa2388-a0d5-4838-8004-15f5341267c5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.803007 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa2388-a0d5-4838-8004-15f5341267c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.803292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa2388-a0d5-4838-8004-15f5341267c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:22.804183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa2388-a0d5-4838-8004-15f5341267c5 None admin] RBAC: Adding query filter params (role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=2a63d9b074144aa49bea1d60271c535e, user.id=62021fc44d1d46b4bb546313a7051d59) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:22.804603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa2388-a0d5-4838-8004-15f5341267c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:22.806070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa2388-a0d5-4838-8004-15f5341267c5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:22.807321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:22.813434 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 139/273] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:22 2022] GET /identity/v3/role_assignments?user.id=62021fc44d1d46b4bb546313a7051d59&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:22.814251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa2388-a0d5-4838-8004-15f5341267c5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:22.914015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd5eb1-044f-4cd3-adb8-7c55b85682cd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:22.973360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:22.997237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba88c8e-5ea8-4b29-b728-dbfd262059df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:22.998046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba88c8e-5ea8-4b29-b728-dbfd262059df None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:22.998330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba88c8e-5ea8-4b29-b728-dbfd262059df None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:22.998608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba88c8e-5ea8-4b29-b728-dbfd262059df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:23.002946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa2388-a0d5-4838-8004-15f5341267c5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:23.016831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba88c8e-5ea8-4b29-b728-dbfd262059df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-7ba88c8e-5ea8-4b29-b728-dbfd262059df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:23.026476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:23.027368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:23.028206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 135/274] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:23.034861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba88c8e-5ea8-4b29-b728-dbfd262059df None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:23.050585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a0f6e-40ed-4f06-a45f-3ea9e9644034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:23.052111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a0f6e-40ed-4f06-a45f-3ea9e9644034 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:23.052656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a0f6e-40ed-4f06-a45f-3ea9e9644034 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:23.053121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a0f6e-40ed-4f06-a45f-3ea9e9644034 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:23.054381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a0f6e-40ed-4f06-a45f-3ea9e9644034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:23.055844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a0f6e-40ed-4f06-a45f-3ea9e9644034 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:23.057657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 140/275] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:23.062978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a0f6e-40ed-4f06-a45f-3ea9e9644034 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:23.190219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a0f6e-40ed-4f06-a45f-3ea9e9644034 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:23.193978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba88c8e-5ea8-4b29-b728-dbfd262059df None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:23.197029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:23.233993 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ecde4-89ac-4dc5-bcb1-a97c82e2eae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:23.235083 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ecde4-89ac-4dc5-bcb1-a97c82e2eae2 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:23.235857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ecde4-89ac-4dc5-bcb1-a97c82e2eae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:23.236612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ecde4-89ac-4dc5-bcb1-a97c82e2eae2 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:23.237591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ecde4-89ac-4dc5-bcb1-a97c82e2eae2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:23.239406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ecde4-89ac-4dc5-bcb1-a97c82e2eae2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:23.240937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3825-925a-4b7f-9924-a08358b849c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:23.241880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3825-925a-4b7f-9924-a08358b849c6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:23.242390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3825-925a-4b7f-9924-a08358b849c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:23.242883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3825-925a-4b7f-9924-a08358b849c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:23.243848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3825-925a-4b7f-9924-a08358b849c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:23.244403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3825-925a-4b7f-9924-a08358b849c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:23.245978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3825-925a-4b7f-9924-a08358b849c6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:23.261425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 136/276] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:23.270182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3825-925a-4b7f-9924-a08358b849c6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:23.272477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 141/277] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:23 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:23.394162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3825-925a-4b7f-9924-a08358b849c6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:23.433599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3edf3-b079-4adb-a9bf-49cd576165ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:23.434886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3edf3-b079-4adb-a9bf-49cd576165ce None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:23.435391 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3edf3-b079-4adb-a9bf-49cd576165ce None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:23.435940 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3edf3-b079-4adb-a9bf-49cd576165ce None admin] PATH_INFO: `/v3/users/3998fcd4849a4e1f89b98e7e95871fc1` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:23.452139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3edf3-b079-4adb-a9bf-49cd576165ce None admin] RBAC: Authorizing `identity:get_user(user_id=3998fcd4849a4e1f89b98e7e95871fc1)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:23.453956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3edf3-b079-4adb-a9bf-49cd576165ce None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:23.456465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 137/278] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:23 2022] GET /identity/v3/users/3998fcd4849a4e1f89b98e7e95871fc1 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:23.463337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ecde4-89ac-4dc5-bcb1-a97c82e2eae2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:23.468496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:23.575710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ecde4-89ac-4dc5-bcb1-a97c82e2eae2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:23.610955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c2d1-f3a8-4dda-a3de-43328f8edac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:23.611678 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c2d1-f3a8-4dda-a3de-43328f8edac4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:23.612001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c2d1-f3a8-4dda-a3de-43328f8edac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:23.612286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c2d1-f3a8-4dda-a3de-43328f8edac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:23.613137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3c2d1-f3a8-4dda-a3de-43328f8edac4 None admin] RBAC: Adding query filter params (role.id=edfcc7d2aec44b54ab2c3f4809908b08, user.id=3998fcd4849a4e1f89b98e7e95871fc1, scope.system=all) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:23.613463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3c2d1-f3a8-4dda-a3de-43328f8edac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:23.614984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3c2d1-f3a8-4dda-a3de-43328f8edac4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:23.620998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 142/279] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 13 21:58:23 2022] GET /identity/v3/role_assignments?user.id=3998fcd4849a4e1f89b98e7e95871fc1&scope.system=all&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:23.699191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cca697-28e3-4637-a3ba-5a66ff325b97 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:23.699482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cca697-28e3-4637-a3ba-5a66ff325b97 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:23.699676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cca697-28e3-4637-a3ba-5a66ff325b97 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:23.701454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 138/280] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:23.707280 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e629590-bbdc-469f-9507-1abfed484275 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:23.707573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e629590-bbdc-469f-9507-1abfed484275 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:23.707849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e629590-bbdc-469f-9507-1abfed484275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:23.727822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0e629590-bbdc-469f-9507-1abfed484275 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:23.729615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0e629590-bbdc-469f-9507-1abfed484275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:23.803770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:23.809743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 143/281] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:23.833031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cca697-28e3-4637-a3ba-5a66ff325b97 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:23.860487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:23.983648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cca697-28e3-4637-a3ba-5a66ff325b97 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:24.020186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7828-f334-4054-99b8-848070400d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:24.021562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7828-f334-4054-99b8-848070400d6a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:24.022406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7828-f334-4054-99b8-848070400d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:24.022695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7828-f334-4054-99b8-848070400d6a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:24.033641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7828-f334-4054-99b8-848070400d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4b4e7828-f334-4054-99b8-848070400d6a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:24.042485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:24.043376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:24.044230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 139/282] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:24.049557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e629590-bbdc-469f-9507-1abfed484275 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:24.203140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e629590-bbdc-469f-9507-1abfed484275 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:24.238240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe621c-2cbe-4667-bc6b-d405b145b41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:24.238835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe621c-2cbe-4667-bc6b-d405b145b41d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:24.239126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe621c-2cbe-4667-bc6b-d405b145b41d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:24.239407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe621c-2cbe-4667-bc6b-d405b145b41d None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:24.240225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe621c-2cbe-4667-bc6b-d405b145b41d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:24.240537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe621c-2cbe-4667-bc6b-d405b145b41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:24.241910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe621c-2cbe-4667-bc6b-d405b145b41d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:24.250664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 144/283] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:24.257388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7828-f334-4054-99b8-848070400d6a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:24.358829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4714-59d1-4d0b-ae74-a592991b7cff None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:24.359493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4714-59d1-4d0b-ae74-a592991b7cff None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:24.360005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4714-59d1-4d0b-ae74-a592991b7cff None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:24.361840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 145/284] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:24.367856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaebaa1-8171-4a79-b3f6-de4126927f7c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:24.368436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaebaa1-8171-4a79-b3f6-de4126927f7c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:24.368939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaebaa1-8171-4a79-b3f6-de4126927f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:24.386596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0aaebaa1-8171-4a79-b3f6-de4126927f7c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:24.388129 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0aaebaa1-8171-4a79-b3f6-de4126927f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:24.412518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:24.436933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7828-f334-4054-99b8-848070400d6a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:24.467537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:24.475574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d68f6e-9a35-457c-81c5-567618c56618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:24.476742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d68f6e-9a35-457c-81c5-567618c56618 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:24.477232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d68f6e-9a35-457c-81c5-567618c56618 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:24.477705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d68f6e-9a35-457c-81c5-567618c56618 None admin] PATH_INFO: `/v3/users/3d3782fd69a44cde8f05f5342f1c4ca4` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:24.479151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d68f6e-9a35-457c-81c5-567618c56618 None admin] RBAC: Authorizing `identity:get_user(user_id=3d3782fd69a44cde8f05f5342f1c4ca4)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:24.480904 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d68f6e-9a35-457c-81c5-567618c56618 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:24.483081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 140/285] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:24 2022] GET /identity/v3/users/3d3782fd69a44cde8f05f5342f1c4ca4 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:24.488899 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d68f6e-9a35-457c-81c5-567618c56618 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:24.490342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 146/286] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:24.573788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaebaa1-8171-4a79-b3f6-de4126927f7c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:24.636175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d68f6e-9a35-457c-81c5-567618c56618 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:24.698385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25cb47-0f7c-479c-ab00-ba03b40e7256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:24.699261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25cb47-0f7c-479c-ab00-ba03b40e7256 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:24.699548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25cb47-0f7c-479c-ab00-ba03b40e7256 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:24.699827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25cb47-0f7c-479c-ab00-ba03b40e7256 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:24.701323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25cb47-0f7c-479c-ab00-ba03b40e7256 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:24.702765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25cb47-0f7c-479c-ab00-ba03b40e7256 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:24.704961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 141/287] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:24 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:24.712463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25cb47-0f7c-479c-ab00-ba03b40e7256 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:24.737749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:24.785112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaebaa1-8171-4a79-b3f6-de4126927f7c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:24.857275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f494-c606-4617-b9e9-5c4ae7b68f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:24.858095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f494-c606-4617-b9e9-5c4ae7b68f55 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:24.858384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f494-c606-4617-b9e9-5c4ae7b68f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:24.858666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f494-c606-4617-b9e9-5c4ae7b68f55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:24.871726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25cb47-0f7c-479c-ab00-ba03b40e7256 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:24.897926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8f494-c606-4617-b9e9-5c4ae7b68f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-91d8f494-c606-4617-b9e9-5c4ae7b68f55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:24.905864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:24.906770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:24.907540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 147/288] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:24.916596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f494-c606-4617-b9e9-5c4ae7b68f55 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:24.918432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770f874-542a-4e96-a25c-805cf4af34f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:24.919345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770f874-542a-4e96-a25c-805cf4af34f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:24.919634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770f874-542a-4e96-a25c-805cf4af34f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:24.919928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770f874-542a-4e96-a25c-805cf4af34f6 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e/users/3d3782fd69a44cde8f05f5342f1c4ca4/roles/186bf8f58360412bb8ab604514e2c321` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:24.924496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770f874-542a-4e96-a25c-805cf4af34f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a63d9b074144aa49bea1d60271c535e, user_id=3d3782fd69a44cde8f05f5342f1c4ca4, role_id=186bf8f58360412bb8ab604514e2c321)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:24.932044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770f874-542a-4e96-a25c-805cf4af34f6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:24.954452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 142/289] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:58:24 2022] PUT /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e/users/3d3782fd69a44cde8f05f5342f1c4ca4/roles/186bf8f58360412bb8ab604514e2c321 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 21:58:25.017748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:25.077638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f494-c606-4617-b9e9-5c4ae7b68f55 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:25.143476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204c84-4b2f-4e30-81c1-ed73b0604d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:25.144194 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204c84-4b2f-4e30-81c1-ed73b0604d7e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:25.144484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204c84-4b2f-4e30-81c1-ed73b0604d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:25.144766 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204c84-4b2f-4e30-81c1-ed73b0604d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:25.145530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204c84-4b2f-4e30-81c1-ed73b0604d7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:25.145920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204c84-4b2f-4e30-81c1-ed73b0604d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:25.147504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204c84-4b2f-4e30-81c1-ed73b0604d7e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:25.157648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 148/290] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:25.164584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770f874-542a-4e96-a25c-805cf4af34f6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:25.267259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:25.296009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770f874-542a-4e96-a25c-805cf4af34f6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:25.344864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045a046-3348-464f-ba1f-530c252e635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:25.346092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045a046-3348-464f-ba1f-530c252e635d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:25.346578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045a046-3348-464f-ba1f-530c252e635d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:25.347071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045a046-3348-464f-ba1f-530c252e635d None admin] PATH_INFO: `/v3/users/569dae02eb4549bfa5c0d125acebeacb` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:25.352641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045a046-3348-464f-ba1f-530c252e635d None admin] RBAC: Authorizing `identity:get_user(user_id=569dae02eb4549bfa5c0d125acebeacb)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:25.354315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045a046-3348-464f-ba1f-530c252e635d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:25.356863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 143/291] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:25 2022] GET /identity/v3/users/569dae02eb4549bfa5c0d125acebeacb => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:25.361946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204c84-4b2f-4e30-81c1-ed73b0604d7e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:25.488687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204c84-4b2f-4e30-81c1-ed73b0604d7e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:25.506793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:25.537171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b08b2a-d5a0-4e5e-aa7b-fa89b53b7795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:25.537960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b08b2a-d5a0-4e5e-aa7b-fa89b53b7795 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:25.538303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b08b2a-d5a0-4e5e-aa7b-fa89b53b7795 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:25.538595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b08b2a-d5a0-4e5e-aa7b-fa89b53b7795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:25.627221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b08b2a-d5a0-4e5e-aa7b-fa89b53b7795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:25.628953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b08b2a-d5a0-4e5e-aa7b-fa89b53b7795 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:25.736607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 149/292] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:25.742702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045a046-3348-464f-ba1f-530c252e635d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:25.881387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045a046-3348-464f-ba1f-530c252e635d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:25.923373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a99eb-221d-40fd-983d-cbda89796414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:25.924649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a99eb-221d-40fd-983d-cbda89796414 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:25.925137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a99eb-221d-40fd-983d-cbda89796414 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:25.925614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a99eb-221d-40fd-983d-cbda89796414 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:25.932600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a99eb-221d-40fd-983d-cbda89796414 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:25.934271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a99eb-221d-40fd-983d-cbda89796414 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:25.936638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 144/293] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:25 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:25.942190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b08b2a-d5a0-4e5e-aa7b-fa89b53b7795 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:25.966466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:26.059587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b08b2a-d5a0-4e5e-aa7b-fa89b53b7795 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:26.087419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a793-9a00-4a3b-b027-c1e34efb1eb6 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.088128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a793-9a00-4a3b-b027-c1e34efb1eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.088612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a793-9a00-4a3b-b027-c1e34efb1eb6 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.090357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 145/294] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:26.094824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afdf7d-4a74-40ed-b126-4960ed9ef260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:26.095480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afdf7d-4a74-40ed-b126-4960ed9ef260 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.095765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afdf7d-4a74-40ed-b126-4960ed9ef260 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.096075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afdf7d-4a74-40ed-b126-4960ed9ef260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.096270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194778-8cd0-4191-9dd9-010c7878909d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.096743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194778-8cd0-4191-9dd9-010c7878909d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.096921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afdf7d-4a74-40ed-b126-4960ed9ef260 None admin] RBAC: Adding query filter params (role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=2a63d9b074144aa49bea1d60271c535e, user.id=569dae02eb4549bfa5c0d125acebeacb) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:26.097222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afdf7d-4a74-40ed-b126-4960ed9ef260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:26.097571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194778-8cd0-4191-9dd9-010c7878909d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.098661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afdf7d-4a74-40ed-b126-4960ed9ef260 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:26.105620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 150/295] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:25 2022] GET /identity/v3/role_assignments?user.id=569dae02eb4549bfa5c0d125acebeacb&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:26.130514 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-52194778-8cd0-4191-9dd9-010c7878909d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:26.132205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-52194778-8cd0-4191-9dd9-010c7878909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:26.144475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:26.205304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658bd9-ea18-400a-9b41-a87dbfb2ebc4 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.205939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658bd9-ea18-400a-9b41-a87dbfb2ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.206447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658bd9-ea18-400a-9b41-a87dbfb2ebc4 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.209133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 151/296] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:26.214973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3103191-5247-4aa0-95ae-15434df2f6f2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.215246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 146/297] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:26.215741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3103191-5247-4aa0-95ae-15434df2f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.216265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3103191-5247-4aa0-95ae-15434df2f6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.238911 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52194778-8cd0-4191-9dd9-010c7878909d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:26.251407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f3103191-5247-4aa0-95ae-15434df2f6f2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:26.254549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f3103191-5247-4aa0-95ae-15434df2f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:26.373588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 152/298] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:26.376181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6a614-2e6f-4bcd-83b7-06d069e8f8d4 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.376622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6a614-2e6f-4bcd-83b7-06d069e8f8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.377049 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6a614-2e6f-4bcd-83b7-06d069e8f8d4 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.378868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 153/299] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:26.385918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458abf3-da0e-4122-ba96-66a74a379bd2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.386155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458abf3-da0e-4122-ba96-66a74a379bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.386411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458abf3-da0e-4122-ba96-66a74a379bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.401724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:26.408343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52194778-8cd0-4191-9dd9-010c7878909d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:26.410019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7458abf3-da0e-4122-ba96-66a74a379bd2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:26.412641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7458abf3-da0e-4122-ba96-66a74a379bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:26.464259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1a117-131b-41f7-b2b6-cb3fb0c8fd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:26.465434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1a117-131b-41f7-b2b6-cb3fb0c8fd79 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.465719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1a117-131b-41f7-b2b6-cb3fb0c8fd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.465987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1a117-131b-41f7-b2b6-cb3fb0c8fd79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.467172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1a117-131b-41f7-b2b6-cb3fb0c8fd79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:26.468717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1a117-131b-41f7-b2b6-cb3fb0c8fd79 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:26.470348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 147/300] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:26.471336 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1a117-131b-41f7-b2b6-cb3fb0c8fd79 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:26.488777 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:26.500203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 154/301] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:26.501449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458abf3-da0e-4122-ba96-66a74a379bd2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:26.577957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1a117-131b-41f7-b2b6-cb3fb0c8fd79 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:26.613922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458abf3-da0e-4122-ba96-66a74a379bd2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:26.614187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d10280-d188-4076-b4be-69705dfd2913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:26.615698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d10280-d188-4076-b4be-69705dfd2913 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.616004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d10280-d188-4076-b4be-69705dfd2913 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.616469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d10280-d188-4076-b4be-69705dfd2913 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.626669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d10280-d188-4076-b4be-69705dfd2913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-d2d10280-d188-4076-b4be-69705dfd2913 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:26.634412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:26.635273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:26.636119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 148/302] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:26.637815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d10280-d188-4076-b4be-69705dfd2913 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:26.655617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c925d-2e8d-492a-8c0e-4d2887a00be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:26.656320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c925d-2e8d-492a-8c0e-4d2887a00be6 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.656622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c925d-2e8d-492a-8c0e-4d2887a00be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.656889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c925d-2e8d-492a-8c0e-4d2887a00be6 None admin] PATH_INFO: `/v3/groups` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.657575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c925d-2e8d-492a-8c0e-4d2887a00be6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:26.659441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c925d-2e8d-492a-8c0e-4d2887a00be6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:26.665108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:26.677542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 155/303] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Jul 13 21:58:26 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:26.678906 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c925d-2e8d-492a-8c0e-4d2887a00be6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:26.744529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:26.772704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d10280-d188-4076-b4be-69705dfd2913 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:26.799920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c925d-2e8d-492a-8c0e-4d2887a00be6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:26.821625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3714faa-397c-4cf4-86f3-320d63c60f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:26.822833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3714faa-397c-4cf4-86f3-320d63c60f5c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.823338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3714faa-397c-4cf4-86f3-320d63c60f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.824494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3714faa-397c-4cf4-86f3-320d63c60f5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.841163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3714faa-397c-4cf4-86f3-320d63c60f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:26.841356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6453d16-bc04-4f4f-a981-68504577c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:26.842103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6453d16-bc04-4f4f-a981-68504577c34a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:26.842392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6453d16-bc04-4f4f-a981-68504577c34a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:26.842770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6453d16-bc04-4f4f-a981-68504577c34a None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:26.843744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6453d16-bc04-4f4f-a981-68504577c34a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:26.844152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6453d16-bc04-4f4f-a981-68504577c34a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:26.845567 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6453d16-bc04-4f4f-a981-68504577c34a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c3714faa-397c-4cf4-86f3-320d63c60f5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:26.853816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:26.854746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:26.855606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:26.861733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 149/304] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:26.861871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 156/305] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:26.863399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3714faa-397c-4cf4-86f3-320d63c60f5c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:26.865479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6453d16-bc04-4f4f-a981-68504577c34a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:26.946895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:26.994489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6453d16-bc04-4f4f-a981-68504577c34a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:27.001088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3714faa-397c-4cf4-86f3-320d63c60f5c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:27.029970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab8747-8aaa-42f2-a239-b60db04d98e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:27.030850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab8747-8aaa-42f2-a239-b60db04d98e2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:27.031133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab8747-8aaa-42f2-a239-b60db04d98e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:27.031407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab8747-8aaa-42f2-a239-b60db04d98e2 None admin] PATH_INFO: `/v3/users/2e480ee9ef1d48a8ad4944195277cbea` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:27.047356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab8747-8aaa-42f2-a239-b60db04d98e2 None admin] RBAC: Authorizing `identity:get_user(user_id=2e480ee9ef1d48a8ad4944195277cbea)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:27.048269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f0afb-5331-40e0-a158-a4205a68cdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:27.048903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab8747-8aaa-42f2-a239-b60db04d98e2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:27.049426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f0afb-5331-40e0-a158-a4205a68cdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:27.049907 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f0afb-5331-40e0-a158-a4205a68cdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:27.050381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f0afb-5331-40e0-a158-a4205a68cdf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:27.050879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 157/306] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:26 2022] GET /identity/v3/users/2e480ee9ef1d48a8ad4944195277cbea => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:27.051945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f0afb-5331-40e0-a158-a4205a68cdf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:27.053238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f0afb-5331-40e0-a158-a4205a68cdf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:27.054860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f0afb-5331-40e0-a158-a4205a68cdf9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:27.056721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:27.056910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab8747-8aaa-42f2-a239-b60db04d98e2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:27.072590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 150/307] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:27.073817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f0afb-5331-40e0-a158-a4205a68cdf9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:27.180746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab8747-8aaa-42f2-a239-b60db04d98e2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:27.201966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:27.202188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f0afb-5331-40e0-a158-a4205a68cdf9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:27.223487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9684b-211f-4f91-9a28-836e987e840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:27.225396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9684b-211f-4f91-9a28-836e987e840b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:27.225856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9684b-211f-4f91-9a28-836e987e840b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:27.226308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9684b-211f-4f91-9a28-836e987e840b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:27.227343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9684b-211f-4f91-9a28-836e987e840b None admin] RBAC: Adding query filter params (role.id=186bf8f58360412bb8ab604514e2c321, user.id=2e480ee9ef1d48a8ad4944195277cbea, scope.system=all) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:27.227670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9684b-211f-4f91-9a28-836e987e840b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:27.229186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9684b-211f-4f91-9a28-836e987e840b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:27.234964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 158/308] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 13 21:58:27 2022] GET /identity/v3/role_assignments?user.id=2e480ee9ef1d48a8ad4944195277cbea&scope.system=all&role.id=186bf8f58360412bb8ab604514e2c321 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:27.248614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502e1eb-7efb-4f09-ad81-76de8a89c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:27.249922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502e1eb-7efb-4f09-ad81-76de8a89c79f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:27.250487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502e1eb-7efb-4f09-ad81-76de8a89c79f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:27.250985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502e1eb-7efb-4f09-ad81-76de8a89c79f None admin] PATH_INFO: `/v3/users/3998fcd4849a4e1f89b98e7e95871fc1` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:27.252767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502e1eb-7efb-4f09-ad81-76de8a89c79f None admin] RBAC: Authorizing `identity:get_user(user_id=3998fcd4849a4e1f89b98e7e95871fc1)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:27.254476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502e1eb-7efb-4f09-ad81-76de8a89c79f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:27.256659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 151/309] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:27 2022] GET /identity/v3/users/3998fcd4849a4e1f89b98e7e95871fc1 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:27.262873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9684b-211f-4f91-9a28-836e987e840b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:27.383889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9684b-211f-4f91-9a28-836e987e840b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:27.390421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4759ef-9c78-4260-837b-086afaae2dff None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:27.390717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4759ef-9c78-4260-837b-086afaae2dff None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:27.391000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4759ef-9c78-4260-837b-086afaae2dff None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:27.392669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 152/310] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:27.398078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfd480-87f8-4c05-8648-b8129c5e14cc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:27.398692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfd480-87f8-4c05-8648-b8129c5e14cc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:27.399183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfd480-87f8-4c05-8648-b8129c5e14cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:27.418481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-37cfd480-87f8-4c05-8648-b8129c5e14cc None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:27.419667 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-37cfd480-87f8-4c05-8648-b8129c5e14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:27.420912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af43bc5-e6aa-4495-94ea-e6dffd7083c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:27.422027 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af43bc5-e6aa-4495-94ea-e6dffd7083c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:27.422535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af43bc5-e6aa-4495-94ea-e6dffd7083c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:27.423015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af43bc5-e6aa-4495-94ea-e6dffd7083c1 None admin] PATH_INFO: `/v3/system/users/3998fcd4849a4e1f89b98e7e95871fc1/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:27.424813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af43bc5-e6aa-4495-94ea-e6dffd7083c1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3998fcd4849a4e1f89b98e7e95871fc1, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:27.426415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af43bc5-e6aa-4495-94ea-e6dffd7083c1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:27.438979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 159/311] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jul 13 21:58:27 2022] PUT /identity/v3/system/users/3998fcd4849a4e1f89b98e7e95871fc1/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:27.500033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:27.510183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 153/312] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:27.536197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af43bc5-e6aa-4495-94ea-e6dffd7083c1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:27.595093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:27.652675 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af43bc5-e6aa-4495-94ea-e6dffd7083c1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:27.687836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0e587-3fbb-441e-8ddb-131cfc178f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:27.688677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0e587-3fbb-441e-8ddb-131cfc178f60 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:27.689067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0e587-3fbb-441e-8ddb-131cfc178f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:27.689350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0e587-3fbb-441e-8ddb-131cfc178f60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:27.700122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0e587-3fbb-441e-8ddb-131cfc178f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-a2a0e587-3fbb-441e-8ddb-131cfc178f60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:27.707929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:27.709602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:27.710378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 160/313] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:27.715987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfd480-87f8-4c05-8648-b8129c5e14cc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:27.817850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfd480-87f8-4c05-8648-b8129c5e14cc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:27.853271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd167a-b7eb-4628-b939-3d04ba06576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:27.854013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd167a-b7eb-4628-b939-3d04ba06576f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:27.854305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd167a-b7eb-4628-b939-3d04ba06576f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:27.854588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd167a-b7eb-4628-b939-3d04ba06576f None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:27.855437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd167a-b7eb-4628-b939-3d04ba06576f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:27.855754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd167a-b7eb-4628-b939-3d04ba06576f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:27.857165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd167a-b7eb-4628-b939-3d04ba06576f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:27.866446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 154/314] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:27.872139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0e587-3fbb-441e-8ddb-131cfc178f60 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:27.980817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0e587-3fbb-441e-8ddb-131cfc178f60 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:27.983198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:28.016646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff8cf2-81f5-4fca-a759-18493ae9b2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:28.017594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff8cf2-81f5-4fca-a759-18493ae9b2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:28.017887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff8cf2-81f5-4fca-a759-18493ae9b2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:28.018211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff8cf2-81f5-4fca-a759-18493ae9b2d5 None admin] PATH_INFO: `/v3/users/3d3782fd69a44cde8f05f5342f1c4ca4` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:28.019447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff8cf2-81f5-4fca-a759-18493ae9b2d5 None admin] RBAC: Authorizing `identity:get_user(user_id=3d3782fd69a44cde8f05f5342f1c4ca4)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:28.020996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff8cf2-81f5-4fca-a759-18493ae9b2d5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:28.023050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 161/315] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:27 2022] GET /identity/v3/users/3d3782fd69a44cde8f05f5342f1c4ca4 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:28.028669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd167a-b7eb-4628-b939-3d04ba06576f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:28.091460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:28.137589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd167a-b7eb-4628-b939-3d04ba06576f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:28.171342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab035-08d3-4b3e-a269-4e6c355a24e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:28.172027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab035-08d3-4b3e-a269-4e6c355a24e5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:28.172315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab035-08d3-4b3e-a269-4e6c355a24e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:28.172588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab035-08d3-4b3e-a269-4e6c355a24e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:28.243725 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ab035-08d3-4b3e-a269-4e6c355a24e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:28.245207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ab035-08d3-4b3e-a269-4e6c355a24e5 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:28.302726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:28.350824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 155/316] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:28.356122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff8cf2-81f5-4fca-a759-18493ae9b2d5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:28.461923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff8cf2-81f5-4fca-a759-18493ae9b2d5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:28.497877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee870f-445a-4acb-b985-c2cd6db2cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:28.499077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee870f-445a-4acb-b985-c2cd6db2cfec None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:28.499591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee870f-445a-4acb-b985-c2cd6db2cfec None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:28.500100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee870f-445a-4acb-b985-c2cd6db2cfec None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:28.501501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee870f-445a-4acb-b985-c2cd6db2cfec None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:28.503141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee870f-445a-4acb-b985-c2cd6db2cfec None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:28.505510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 162/317] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:28 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:28.511583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab035-08d3-4b3e-a269-4e6c355a24e5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:28.620552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab035-08d3-4b3e-a269-4e6c355a24e5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:28.655807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59802b3d-0e64-4bcb-be5f-a7c536704677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:28.656500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59802b3d-0e64-4bcb-be5f-a7c536704677 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:28.656787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59802b3d-0e64-4bcb-be5f-a7c536704677 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:28.657066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59802b3d-0e64-4bcb-be5f-a7c536704677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:28.657902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59802b3d-0e64-4bcb-be5f-a7c536704677 None admin] RBAC: Adding query filter params (role.id=186bf8f58360412bb8ab604514e2c321, scope.project.id=2a63d9b074144aa49bea1d60271c535e, user.id=3d3782fd69a44cde8f05f5342f1c4ca4) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:28.658218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59802b3d-0e64-4bcb-be5f-a7c536704677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:28.659651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59802b3d-0e64-4bcb-be5f-a7c536704677 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:28.666116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 156/318] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:28 2022] GET /identity/v3/role_assignments?user.id=3d3782fd69a44cde8f05f5342f1c4ca4&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=186bf8f58360412bb8ab604514e2c321 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:28.945033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e286d-f341-42c9-a612-60a385be30bc None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:28.945243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e286d-f341-42c9-a612-60a385be30bc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:28.945693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e286d-f341-42c9-a612-60a385be30bc None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:28.947228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 163/319] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:28.952299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa49f5-5a90-4e60-9820-86422f600ae7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:28.952596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa49f5-5a90-4e60-9820-86422f600ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:28.952875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa49f5-5a90-4e60-9820-86422f600ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:28.970774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9afa49f5-5a90-4e60-9820-86422f600ae7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:28.971994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9afa49f5-5a90-4e60-9820-86422f600ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:28.987616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:29.044504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 157/320] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:29.066853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e286d-f341-42c9-a612-60a385be30bc None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:29.117092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:29.176187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e286d-f341-42c9-a612-60a385be30bc None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:29.212669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071d54-26e4-4826-9d40-c564f3d8fe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:29.213382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071d54-26e4-4826-9d40-c564f3d8fe97 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.213666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071d54-26e4-4826-9d40-c564f3d8fe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.213942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071d54-26e4-4826-9d40-c564f3d8fe97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.215171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac071d54-26e4-4826-9d40-c564f3d8fe97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:29.216635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac071d54-26e4-4826-9d40-c564f3d8fe97 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:29.218456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 164/321] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:29.223956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa49f5-5a90-4e60-9820-86422f600ae7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:29.322353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa49f5-5a90-4e60-9820-86422f600ae7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:29.330017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65053b-f7ac-4792-a174-ed93f4ca53fb None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.330369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65053b-f7ac-4792-a174-ed93f4ca53fb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.330588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65053b-f7ac-4792-a174-ed93f4ca53fb None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.332121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 165/322] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:29.338075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50bf77-c6f0-4767-bc89-9b19fac71010 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.338388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50bf77-c6f0-4767-bc89-9b19fac71010 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.338643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50bf77-c6f0-4767-bc89-9b19fac71010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.355336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-dd50bf77-c6f0-4767-bc89-9b19fac71010 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:29.356655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dd50bf77-c6f0-4767-bc89-9b19fac71010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:29.359607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89031-b962-4b49-82c4-3b9b44778a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:29.360311 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89031-b962-4b49-82c4-3b9b44778a9a None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.360600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89031-b962-4b49-82c4-3b9b44778a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.360877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89031-b962-4b49-82c4-3b9b44778a9a None admin] PATH_INFO: `/v3/groups` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.361573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e89031-b962-4b49-82c4-3b9b44778a9a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:29.363003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e89031-b962-4b49-82c4-3b9b44778a9a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:29.379526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 158/323] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Jul 13 21:58:29 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:29.438698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 166/324] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:29.461860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89031-b962-4b49-82c4-3b9b44778a9a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:29.475329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:29.559421 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2865d81-251e-41e3-8b6a-76e7dcd5e91a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.559978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2865d81-251e-41e3-8b6a-76e7dcd5e91a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.559978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2865d81-251e-41e3-8b6a-76e7dcd5e91a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.561373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 167/325] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:29.566377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff768-752d-4fa6-8ff4-e9e5751fda2f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.566663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff768-752d-4fa6-8ff4-e9e5751fda2f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.566944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff768-752d-4fa6-8ff4-e9e5751fda2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.572553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89031-b962-4b49-82c4-3b9b44778a9a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:29.586619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-12eff768-752d-4fa6-8ff4-e9e5751fda2f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:29.587641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-12eff768-752d-4fa6-8ff4-e9e5751fda2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:29.610299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eca0d-c336-4a68-9f68-61395bee1686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:29.611163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eca0d-c336-4a68-9f68-61395bee1686 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.611448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eca0d-c336-4a68-9f68-61395bee1686 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.611778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eca0d-c336-4a68-9f68-61395bee1686 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.622856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eca0d-c336-4a68-9f68-61395bee1686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:29.629191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-fa7eca0d-c336-4a68-9f68-61395bee1686 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:29.633204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:29.634080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:29.634848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 159/326] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:29.640419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eca0d-c336-4a68-9f68-61395bee1686 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:29.683454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 168/327] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:29.713273 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eff768-752d-4fa6-8ff4-e9e5751fda2f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:29.726133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:29.763028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eca0d-c336-4a68-9f68-61395bee1686 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:29.812079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3283090-c357-4e8e-a168-d592f4df71ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:29.812765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283090-c357-4e8e-a168-d592f4df71ee None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.813048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283090-c357-4e8e-a168-d592f4df71ee None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.813328 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283090-c357-4e8e-a168-d592f4df71ee None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.814088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3283090-c357-4e8e-a168-d592f4df71ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:29.814954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3283090-c357-4e8e-a168-d592f4df71ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:29.816377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3283090-c357-4e8e-a168-d592f4df71ee None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:29.828823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 160/328] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:29.834656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3283090-c357-4e8e-a168-d592f4df71ee None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:29.845484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eff768-752d-4fa6-8ff4-e9e5751fda2f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:29.882919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcdd7a-2f99-46eb-a29d-8583914c2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:29.883769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcdd7a-2f99-46eb-a29d-8583914c2664 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.884092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcdd7a-2f99-46eb-a29d-8583914c2664 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.884370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcdd7a-2f99-46eb-a29d-8583914c2664 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.895911 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcdd7a-2f99-46eb-a29d-8583914c2664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-5efcdd7a-2f99-46eb-a29d-8583914c2664 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:29.904389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:29.905291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:29.906114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 169/329] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:29.914925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcdd7a-2f99-46eb-a29d-8583914c2664 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:29.951026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3283090-c357-4e8e-a168-d592f4df71ee None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:29.953398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:29.983058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:29.992133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6ca7-c0ec-4ac5-bf53-8faad050a9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:29.993022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6ca7-c0ec-4ac5-bf53-8faad050a9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:29.993308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6ca7-c0ec-4ac5-bf53-8faad050a9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:29.993581 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6ca7-c0ec-4ac5-bf53-8faad050a9f4 None admin] PATH_INFO: `/v3/users/2e480ee9ef1d48a8ad4944195277cbea` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:29.994798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d6ca7-c0ec-4ac5-bf53-8faad050a9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=2e480ee9ef1d48a8ad4944195277cbea)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:29.996269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d6ca7-c0ec-4ac5-bf53-8faad050a9f4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:30.003008 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 161/330] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:29 2022] GET /identity/v3/users/2e480ee9ef1d48a8ad4944195277cbea => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:30.003885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6ca7-c0ec-4ac5-bf53-8faad050a9f4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:30.035190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcdd7a-2f99-46eb-a29d-8583914c2664 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:30.078523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcb945-f39b-42c0-bc87-05b526a55b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:30.079352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb945-f39b-42c0-bc87-05b526a55b0e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:30.079644 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb945-f39b-42c0-bc87-05b526a55b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:30.079941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb945-f39b-42c0-bc87-05b526a55b0e None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:30.080709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcb945-f39b-42c0-bc87-05b526a55b0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:30.081019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcb945-f39b-42c0-bc87-05b526a55b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:30.082412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcb945-f39b-42c0-bc87-05b526a55b0e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:30.092617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 170/331] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:30.098470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcb945-f39b-42c0-bc87-05b526a55b0e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:30.121672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6ca7-c0ec-4ac5-bf53-8faad050a9f4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:30.161040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9d813-9032-454d-9d19-fb170810d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:30.162202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d813-9032-454d-9d19-fb170810d1d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:30.162484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d813-9032-454d-9d19-fb170810d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:30.162761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d813-9032-454d-9d19-fb170810d1d6 None admin] PATH_INFO: `/v3/system/users/2e480ee9ef1d48a8ad4944195277cbea/roles/186bf8f58360412bb8ab604514e2c321` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:30.164422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9d813-9032-454d-9d19-fb170810d1d6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2e480ee9ef1d48a8ad4944195277cbea, role_id=186bf8f58360412bb8ab604514e2c321)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:30.165903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9d813-9032-454d-9d19-fb170810d1d6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:30.179107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 162/332] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jul 13 21:58:30 2022] PUT /identity/v3/system/users/2e480ee9ef1d48a8ad4944195277cbea/roles/186bf8f58360412bb8ab604514e2c321 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:30.222080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:30.235443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcb945-f39b-42c0-bc87-05b526a55b0e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:30.280832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a8942-b8bc-4e48-88c9-af8aa5cbb112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:30.282186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a8942-b8bc-4e48-88c9-af8aa5cbb112 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:30.282671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a8942-b8bc-4e48-88c9-af8aa5cbb112 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:30.285481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a8942-b8bc-4e48-88c9-af8aa5cbb112 None admin] PATH_INFO: `/v3/users/3998fcd4849a4e1f89b98e7e95871fc1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:30.287506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a8942-b8bc-4e48-88c9-af8aa5cbb112 None admin] RBAC: Authorizing `identity:get_user(user_id=3998fcd4849a4e1f89b98e7e95871fc1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:30.290456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a8942-b8bc-4e48-88c9-af8aa5cbb112 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:30.293117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 171/333] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:30 2022] GET /identity/v3/users/3998fcd4849a4e1f89b98e7e95871fc1 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:30.298712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9d813-9032-454d-9d19-fb170810d1d6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:30.379351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:30.427623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9d813-9032-454d-9d19-fb170810d1d6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:30.470223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b32014-ffe9-41a8-bb42-5f38eb1d3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:30.471266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b32014-ffe9-41a8-bb42-5f38eb1d3a55 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:30.471793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b32014-ffe9-41a8-bb42-5f38eb1d3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:30.472373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b32014-ffe9-41a8-bb42-5f38eb1d3a55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:30.473418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b32014-ffe9-41a8-bb42-5f38eb1d3a55 None admin] RBAC: Adding query filter params (role.id=edfcc7d2aec44b54ab2c3f4809908b08, user.id=3998fcd4849a4e1f89b98e7e95871fc1, scope.system=all) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:30.475069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b32014-ffe9-41a8-bb42-5f38eb1d3a55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:30.476879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b32014-ffe9-41a8-bb42-5f38eb1d3a55 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:30.491319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 163/334] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 13 21:58:30 2022] GET /identity/v3/role_assignments?user.id=3998fcd4849a4e1f89b98e7e95871fc1&scope.system=all&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:31.920103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf668-c718-474e-8575-e107f586fef3 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:31.921111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf668-c718-474e-8575-e107f586fef3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:31.921594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf668-c718-474e-8575-e107f586fef3 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:31.923472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 172/335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:31.929371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d020a94-d7c7-462d-b634-efa95c94bd4c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:31.930232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d020a94-d7c7-462d-b634-efa95c94bd4c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:31.930706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d020a94-d7c7-462d-b634-efa95c94bd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:31.952617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2d020a94-d7c7-462d-b634-efa95c94bd4c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:31.954154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2d020a94-d7c7-462d-b634-efa95c94bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:32.039319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 164/336] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:32.081547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcf668-c718-474e-8575-e107f586fef3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:32.224925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcf668-c718-474e-8575-e107f586fef3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:32.262902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67838500-4d26-45c1-98d5-c6ed813d16e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:32.263703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67838500-4d26-45c1-98d5-c6ed813d16e9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:32.264014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67838500-4d26-45c1-98d5-c6ed813d16e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:32.264291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67838500-4d26-45c1-98d5-c6ed813d16e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:32.280958 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67838500-4d26-45c1-98d5-c6ed813d16e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-67838500-4d26-45c1-98d5-c6ed813d16e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:32.289064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:32.289919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:32.291117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 173/337] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:32.299130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d020a94-d7c7-462d-b634-efa95c94bd4c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:32.375644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:32.431850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d020a94-d7c7-462d-b634-efa95c94bd4c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:32.475537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e1980-b6de-4281-9349-68dbe01dd333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:32.476180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e1980-b6de-4281-9349-68dbe01dd333 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:32.476466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e1980-b6de-4281-9349-68dbe01dd333 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:32.476743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e1980-b6de-4281-9349-68dbe01dd333 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:32.477501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e1980-b6de-4281-9349-68dbe01dd333 None admin] RBAC: Adding query filter params (name=member) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:32.477808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e1980-b6de-4281-9349-68dbe01dd333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:32.479185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e1980-b6de-4281-9349-68dbe01dd333 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:32.488436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 165/338] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:32.494051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67838500-4d26-45c1-98d5-c6ed813d16e9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:32.546370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:32.664713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67838500-4d26-45c1-98d5-c6ed813d16e9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:32.714914 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbba53-e22b-4fd6-8a63-0672ba004188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:32.715598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbba53-e22b-4fd6-8a63-0672ba004188 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:32.715888 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbba53-e22b-4fd6-8a63-0672ba004188 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:32.716196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbba53-e22b-4fd6-8a63-0672ba004188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:32.769297 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353df77-c27c-43e3-b909-11b43d885ee5 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:32.769645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353df77-c27c-43e3-b909-11b43d885ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:32.769854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353df77-c27c-43e3-b909-11b43d885ee5 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:32.771472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 166/339] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:58:32.777654 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9f3cc-1669-4d8a-b644-1e1f1862b482 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:32.777944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9f3cc-1669-4d8a-b644-1e1f1862b482 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:32.778222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9f3cc-1669-4d8a-b644-1e1f1862b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:32.802112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b8f9f3cc-1669-4d8a-b644-1e1f1862b482 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:32.803407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b8f9f3cc-1669-4d8a-b644-1e1f1862b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:32.824638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbba53-e22b-4fd6-8a63-0672ba004188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:32.826689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbba53-e22b-4fd6-8a63-0672ba004188 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:32.856265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:32.922532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 167/340] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:32.946870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 174/341] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:32.952849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9f3cc-1669-4d8a-b644-1e1f1862b482 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:32.964321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86b06c-14e2-4f28-b29c-86a5a96d1d1b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:32.964613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86b06c-14e2-4f28-b29c-86a5a96d1d1b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:32.964889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86b06c-14e2-4f28-b29c-86a5a96d1d1b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:32.967610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 175/342] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:58:32.974105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86b06c-14e2-4f28-b29c-86a5a96d1d1b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:33.025820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:33.101734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86b06c-14e2-4f28-b29c-86a5a96d1d1b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:33.130180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9f3cc-1669-4d8a-b644-1e1f1862b482 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:33.140312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:33.153635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc02bb-8879-4479-a2eb-b4620a3189d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:33.154555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc02bb-8879-4479-a2eb-b4620a3189d4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.154989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc02bb-8879-4479-a2eb-b4620a3189d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.155176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc02bb-8879-4479-a2eb-b4620a3189d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.178810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc02bb-8879-4479-a2eb-b4620a3189d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e0bc02bb-8879-4479-a2eb-b4620a3189d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:33.190952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:33.191834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:33.192928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:33.194399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 176/343] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:33.198679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d203af-a45d-438a-aded-44f79cebd887 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.198966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d203af-a45d-438a-aded-44f79cebd887 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.199244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d203af-a45d-438a-aded-44f79cebd887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.201824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b9eaf-55ff-43f1-93b7-97ef829a964a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:33.202685 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9eaf-55ff-43f1-93b7-97ef829a964a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.202966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9eaf-55ff-43f1-93b7-97ef829a964a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.203242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9eaf-55ff-43f1-93b7-97ef829a964a None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.204595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b9eaf-55ff-43f1-93b7-97ef829a964a None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:33.206027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b9eaf-55ff-43f1-93b7-97ef829a964a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:33.209813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 168/344] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:32 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:33.210583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b9eaf-55ff-43f1-93b7-97ef829a964a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:33.239300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-55d203af-a45d-438a-aded-44f79cebd887 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:33.240825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-55d203af-a45d-438a-aded-44f79cebd887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:33.336615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 177/345] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:33.349025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d203af-a45d-438a-aded-44f79cebd887 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:33.394484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b9eaf-55ff-43f1-93b7-97ef829a964a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:33.415412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:33.444215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e332097-acdf-4c63-939c-db8b107156c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:33.444955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e332097-acdf-4c63-939c-db8b107156c2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.445286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e332097-acdf-4c63-939c-db8b107156c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.445569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e332097-acdf-4c63-939c-db8b107156c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.446325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e332097-acdf-4c63-939c-db8b107156c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:33.446632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e332097-acdf-4c63-939c-db8b107156c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:33.448061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e332097-acdf-4c63-939c-db8b107156c2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:33.464022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 169/346] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:33.465626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e332097-acdf-4c63-939c-db8b107156c2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:33.506098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d203af-a45d-438a-aded-44f79cebd887 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:33.518322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:33.556634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a2c53-4aad-4791-9561-bfa0d23db4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:33.557545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a2c53-4aad-4791-9561-bfa0d23db4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.557830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a2c53-4aad-4791-9561-bfa0d23db4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.558111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a2c53-4aad-4791-9561-bfa0d23db4a5 None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.566649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a2c53-4aad-4791-9561-bfa0d23db4a5 None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:33.569651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a2c53-4aad-4791-9561-bfa0d23db4a5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:33.571723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 178/347] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:33 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:33.573505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcafb2e-36d3-4086-a271-03154834b46a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.573793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcafb2e-36d3-4086-a271-03154834b46a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.574073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcafb2e-36d3-4086-a271-03154834b46a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.575826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 179/348] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:33.576765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcafb2e-36d3-4086-a271-03154834b46a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:33.597231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e332097-acdf-4c63-939c-db8b107156c2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:33.642279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8d0c-9ec9-43e6-9b62-8a8b5bc598d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:33.643093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8d0c-9ec9-43e6-9b62-8a8b5bc598d6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.643378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8d0c-9ec9-43e6-9b62-8a8b5bc598d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.643947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8d0c-9ec9-43e6-9b62-8a8b5bc598d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.657861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8d0c-9ec9-43e6-9b62-8a8b5bc598d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-d66c8d0c-9ec9-43e6-9b62-8a8b5bc598d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:33.666747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:33.668916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 170/349] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:33.670401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8d0c-9ec9-43e6-9b62-8a8b5bc598d6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:33.714152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:33.716622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcafb2e-36d3-4086-a271-03154834b46a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:33.762122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d9e98-255a-4086-966b-2b5db9b6a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:33.762788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d9e98-255a-4086-966b-2b5db9b6a14e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.763070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d9e98-255a-4086-966b-2b5db9b6a14e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.763347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d9e98-255a-4086-966b-2b5db9b6a14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.795453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8d0c-9ec9-43e6-9b62-8a8b5bc598d6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:33.820663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:33.845729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c46eeb-7cc1-4c47-8f4a-dedf99dfff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:33.846683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c46eeb-7cc1-4c47-8f4a-dedf99dfff52 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.846965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c46eeb-7cc1-4c47-8f4a-dedf99dfff52 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.847707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c46eeb-7cc1-4c47-8f4a-dedf99dfff52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.849269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c46eeb-7cc1-4c47-8f4a-dedf99dfff52 None admin] RBAC: Adding query filter params (group.id=630c7e3d248740239a5f563d64d25a50, role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=18959bc99d074db3beb4a507e6e95b08) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:33.849707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c46eeb-7cc1-4c47-8f4a-dedf99dfff52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:33.851799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c46eeb-7cc1-4c47-8f4a-dedf99dfff52 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:33.860379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 171/350] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:33 2022] GET /identity/v3/role_assignments?group.id=630c7e3d248740239a5f563d64d25a50&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:33.861030 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d9e98-255a-4086-966b-2b5db9b6a14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:33.861837 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1d3ef-4385-4a52-af91-7de023cdbd8f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:33.862131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1d3ef-4385-4a52-af91-7de023cdbd8f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:33.862412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1d3ef-4385-4a52-af91-7de023cdbd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:33.862579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d9e98-255a-4086-966b-2b5db9b6a14e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:33.884723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8fe1d3ef-4385-4a52-af91-7de023cdbd8f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:33.886319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8fe1d3ef-4385-4a52-af91-7de023cdbd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:33.986247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 172/351] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:33.987107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1d3ef-4385-4a52-af91-7de023cdbd8f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:33.995668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 180/352] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:34.002980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d9e98-255a-4086-966b-2b5db9b6a14e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:34.038761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:34.120797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:34.149000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1d3ef-4385-4a52-af91-7de023cdbd8f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:34.157846 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d9e98-255a-4086-966b-2b5db9b6a14e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:34.186022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334f005-7b3e-43e7-a141-b9869178d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:34.186704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334f005-7b3e-43e7-a141-b9869178d696 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.186988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334f005-7b3e-43e7-a141-b9869178d696 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.187268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334f005-7b3e-43e7-a141-b9869178d696 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.188057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334f005-7b3e-43e7-a141-b9869178d696 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:34.188364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334f005-7b3e-43e7-a141-b9869178d696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:34.189728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334f005-7b3e-43e7-a141-b9869178d696 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:34.195517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6c65-f25e-483f-9f0a-8eed38c9c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:34.196429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6c65-f25e-483f-9f0a-8eed38c9c570 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.196718 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6c65-f25e-483f-9f0a-8eed38c9c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.197003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6c65-f25e-483f-9f0a-8eed38c9c570 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.198234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c6c65-f25e-483f-9f0a-8eed38c9c570 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:34.199283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 173/353] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:34.199696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c6c65-f25e-483f-9f0a-8eed38c9c570 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:34.201457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 181/354] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:34 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:34.201846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e0b5-1c89-4c80-a0b5-340730f0864d None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.202219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6c65-f25e-483f-9f0a-8eed38c9c570 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:34.202557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e0b5-1c89-4c80-a0b5-340730f0864d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.203046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e0b5-1c89-4c80-a0b5-340730f0864d None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.204642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 174/355] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:34.206133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48b973-bf36-4fed-bbce-d4044a67657a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.206622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48b973-bf36-4fed-bbce-d4044a67657a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.207115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48b973-bf36-4fed-bbce-d4044a67657a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.209242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 175/356] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:34.210191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48b973-bf36-4fed-bbce-d4044a67657a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:34.326807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6c65-f25e-483f-9f0a-8eed38c9c570 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:34.327586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:34.342877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48b973-bf36-4fed-bbce-d4044a67657a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:34.374640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2e920-3450-47c7-9a6a-754e47716f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:34.375372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e920-3450-47c7-9a6a-754e47716f80 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.375654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e920-3450-47c7-9a6a-754e47716f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.376882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e920-3450-47c7-9a6a-754e47716f80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.386674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:34.390446 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2e920-3450-47c7-9a6a-754e47716f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:34.394029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4270b-0a8c-43f4-9df8-bf3c957a683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:34.394908 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4270b-0a8c-43f4-9df8-bf3c957a683f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.395190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4270b-0a8c-43f4-9df8-bf3c957a683f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.396195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4270b-0a8c-43f4-9df8-bf3c957a683f None admin] PATH_INFO: `/v3/users/2e480ee9ef1d48a8ad4944195277cbea` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.397354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4270b-0a8c-43f4-9df8-bf3c957a683f None admin] RBAC: Authorizing `identity:get_user(user_id=2e480ee9ef1d48a8ad4944195277cbea)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:34.399228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4270b-0a8c-43f4-9df8-bf3c957a683f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b4d2e920-3450-47c7-9a6a-754e47716f80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:34.401701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:34.402551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:34.403344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:34.405428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 182/358] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:34.405530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 176/358] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:58:34 2022] GET /identity/v3/users/2e480ee9ef1d48a8ad4944195277cbea => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:34.406177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2e920-3450-47c7-9a6a-754e47716f80 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:34.406686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae1471-d780-40d1-a034-f35c3a8403d6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.406971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae1471-d780-40d1-a034-f35c3a8403d6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.407246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae1471-d780-40d1-a034-f35c3a8403d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.433338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a0ae1471-d780-40d1-a034-f35c3a8403d6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:34.435694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a0ae1471-d780-40d1-a034-f35c3a8403d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:34.535328 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 177/359] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:34.536514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2e920-3450-47c7-9a6a-754e47716f80 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:34.536786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362beb55-cd91-4e80-971d-3399c33d88cf None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.537084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362beb55-cd91-4e80-971d-3399c33d88cf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.537368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362beb55-cd91-4e80-971d-3399c33d88cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.558994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-362beb55-cd91-4e80-971d-3399c33d88cf None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:34.560253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-362beb55-cd91-4e80-971d-3399c33d88cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:34.577743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be6c47-1d1b-43c7-8f34-38329122ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:34.578753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be6c47-1d1b-43c7-8f34-38329122ee85 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.579038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be6c47-1d1b-43c7-8f34-38329122ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.579471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be6c47-1d1b-43c7-8f34-38329122ee85 None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.581617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be6c47-1d1b-43c7-8f34-38329122ee85 None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:34.584141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be6c47-1d1b-43c7-8f34-38329122ee85 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:34.586526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 183/360] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:34 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:34.587529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be6c47-1d1b-43c7-8f34-38329122ee85 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:34.640724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 178/361] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:34.641930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362beb55-cd91-4e80-971d-3399c33d88cf None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:34.666108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:34.670979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:34.713752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be6c47-1d1b-43c7-8f34-38329122ee85 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:34.761078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772daef-a8e6-4b5e-b8cb-670cdc77b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:34.762156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772daef-a8e6-4b5e-b8cb-670cdc77b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.762670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772daef-a8e6-4b5e-b8cb-670cdc77b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.762954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772daef-a8e6-4b5e-b8cb-670cdc77b7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.763714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772daef-a8e6-4b5e-b8cb-670cdc77b7b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:34.764396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772daef-a8e6-4b5e-b8cb-670cdc77b7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:34.765492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772daef-a8e6-4b5e-b8cb-670cdc77b7b9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:34.778085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 184/362] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:34.779207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772daef-a8e6-4b5e-b8cb-670cdc77b7b9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:34.783051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362beb55-cd91-4e80-971d-3399c33d88cf None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:34.829492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852dfed-3035-4ad1-a6f0-e0b1fa188359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:34.830264 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852dfed-3035-4ad1-a6f0-e0b1fa188359 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.830549 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852dfed-3035-4ad1-a6f0-e0b1fa188359 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.830824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852dfed-3035-4ad1-a6f0-e0b1fa188359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.831666 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852dfed-3035-4ad1-a6f0-e0b1fa188359 None admin] RBAC: Adding query filter params (role.id=186bf8f58360412bb8ab604514e2c321, user.id=2e480ee9ef1d48a8ad4944195277cbea, scope.system=all) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:34.832003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852dfed-3035-4ad1-a6f0-e0b1fa188359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:34.833817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852dfed-3035-4ad1-a6f0-e0b1fa188359 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:34.846182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 179/363] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 13 21:58:34 2022] GET /identity/v3/role_assignments?user.id=2e480ee9ef1d48a8ad4944195277cbea&scope.system=all&role.id=186bf8f58360412bb8ab604514e2c321 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:34.847094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852dfed-3035-4ad1-a6f0-e0b1fa188359 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:34.922079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772daef-a8e6-4b5e-b8cb-670cdc77b7b9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:34.948258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:34.967634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:34.976489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81849fd1-aff4-48c9-85bd-df44153060ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:34.977446 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81849fd1-aff4-48c9-85bd-df44153060ef None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:34.977734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81849fd1-aff4-48c9-85bd-df44153060ef None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:34.978016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81849fd1-aff4-48c9-85bd-df44153060ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:34.978746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852dfed-3035-4ad1-a6f0-e0b1fa188359 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:34.993266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81849fd1-aff4-48c9-85bd-df44153060ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-81849fd1-aff4-48c9-85bd-df44153060ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:35.004526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:35.006671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:35.007924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 185/364] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:35.009124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81849fd1-aff4-48c9-85bd-df44153060ef None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:35.023034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535dd4a-8098-4d5d-b397-a70e01184bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:35.023795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535dd4a-8098-4d5d-b397-a70e01184bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:35.024172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535dd4a-8098-4d5d-b397-a70e01184bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:35.024583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535dd4a-8098-4d5d-b397-a70e01184bd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:35.025578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535dd4a-8098-4d5d-b397-a70e01184bd7 None admin] RBAC: Adding query filter params (group.id=630c7e3d248740239a5f563d64d25a50, role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=18959bc99d074db3beb4a507e6e95b08) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:35.025956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535dd4a-8098-4d5d-b397-a70e01184bd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:35.027569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535dd4a-8098-4d5d-b397-a70e01184bd7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:35.034151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 180/365] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:34 2022] GET /identity/v3/role_assignments?group.id=630c7e3d248740239a5f563d64d25a50&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:35.034993 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535dd4a-8098-4d5d-b397-a70e01184bd7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:35.169028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81849fd1-aff4-48c9-85bd-df44153060ef None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:35.202894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535dd4a-8098-4d5d-b397-a70e01184bd7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:35.222664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf239-92fd-4faf-9d96-63e9c538e3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:35.223529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf239-92fd-4faf-9d96-63e9c538e3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:35.223817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf239-92fd-4faf-9d96-63e9c538e3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:35.224188 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf239-92fd-4faf-9d96-63e9c538e3b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:35.240718 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cf239-92fd-4faf-9d96-63e9c538e3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-df0cf239-92fd-4faf-9d96-63e9c538e3b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:35.249961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:35.251014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:35.252023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 186/366] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:35.253013 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf239-92fd-4faf-9d96-63e9c538e3b4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:35.262255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc657e-6b22-4cb2-89fd-1efad5d0a599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:35.264147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc657e-6b22-4cb2-89fd-1efad5d0a599 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:35.264591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc657e-6b22-4cb2-89fd-1efad5d0a599 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:35.265021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc657e-6b22-4cb2-89fd-1efad5d0a599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:35.279454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:35.320337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:35.352743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc657e-6b22-4cb2-89fd-1efad5d0a599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:35.354507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc657e-6b22-4cb2-89fd-1efad5d0a599 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:35.378015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf239-92fd-4faf-9d96-63e9c538e3b4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:35.417347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0af77-1532-46a5-96fb-f266c2a7b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:35.418204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0af77-1532-46a5-96fb-f266c2a7b6cd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:35.418556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0af77-1532-46a5-96fb-f266c2a7b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:35.418934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0af77-1532-46a5-96fb-f266c2a7b6cd None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:35.419787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0af77-1532-46a5-96fb-f266c2a7b6cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:35.420224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0af77-1532-46a5-96fb-f266c2a7b6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:35.421690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0af77-1532-46a5-96fb-f266c2a7b6cd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:35.430676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 187/367] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:35.434566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0af77-1532-46a5-96fb-f266c2a7b6cd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:35.477027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 181/368] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:35.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc657e-6b22-4cb2-89fd-1efad5d0a599 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:35.528892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:35.552283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0af77-1532-46a5-96fb-f266c2a7b6cd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:35.566848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:35.600577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc657e-6b22-4cb2-89fd-1efad5d0a599 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:35.601993 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccde80-ee94-4241-a371-225f2a66c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:35.603505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccde80-ee94-4241-a371-225f2a66c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:35.603505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccde80-ee94-4241-a371-225f2a66c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:35.603505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccde80-ee94-4241-a371-225f2a66c1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:35.604307 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccde80-ee94-4241-a371-225f2a66c1e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:35.604619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccde80-ee94-4241-a371-225f2a66c1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:35.607009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccde80-ee94-4241-a371-225f2a66c1e3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:35.618337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 188/369] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:35.619523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccde80-ee94-4241-a371-225f2a66c1e3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:35.649583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517412-50c2-4911-a76e-8e1937089b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:35.650577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517412-50c2-4911-a76e-8e1937089b70 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:35.651045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517412-50c2-4911-a76e-8e1937089b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:35.651503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517412-50c2-4911-a76e-8e1937089b70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:35.742549 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76517412-50c2-4911-a76e-8e1937089b70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:35.744022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76517412-50c2-4911-a76e-8e1937089b70 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:35.765733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccde80-ee94-4241-a371-225f2a66c1e3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:35.793985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:35.811550 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5d7f5-c66a-4de9-8764-6730bfd949de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:35.812449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5d7f5-c66a-4de9-8764-6730bfd949de None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:35.812741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5d7f5-c66a-4de9-8764-6730bfd949de None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:35.813021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5d7f5-c66a-4de9-8764-6730bfd949de None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:35.814757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5d7f5-c66a-4de9-8764-6730bfd949de None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:35.816721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5d7f5-c66a-4de9-8764-6730bfd949de None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:35.820085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 189/370] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:35 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:35.820709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5d7f5-c66a-4de9-8764-6730bfd949de None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:35.870671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 182/371] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:35.871867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517412-50c2-4911-a76e-8e1937089b70 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:35.881843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:35.956098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5d7f5-c66a-4de9-8764-6730bfd949de None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:35.989606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517412-50c2-4911-a76e-8e1937089b70 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:36.005936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439dca1-ac2c-4b36-8e2f-c1e001b03b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:36.007313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439dca1-ac2c-4b36-8e2f-c1e001b03b78 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.008169 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439dca1-ac2c-4b36-8e2f-c1e001b03b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.008739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439dca1-ac2c-4b36-8e2f-c1e001b03b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.030744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938c731-6f3f-4802-bd42-5258d57bd1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:36.031743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938c731-6f3f-4802-bd42-5258d57bd1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.032225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938c731-6f3f-4802-bd42-5258d57bd1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.032744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938c731-6f3f-4802-bd42-5258d57bd1a4 None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.034161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938c731-6f3f-4802-bd42-5258d57bd1a4 None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:36.035692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938c731-6f3f-4802-bd42-5258d57bd1a4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:36.038356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 183/372] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:35 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:36.039285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938c731-6f3f-4802-bd42-5258d57bd1a4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:36.050810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:36.102840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439dca1-ac2c-4b36-8e2f-c1e001b03b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:36.105196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439dca1-ac2c-4b36-8e2f-c1e001b03b78 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:36.156690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:36.175264 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938c731-6f3f-4802-bd42-5258d57bd1a4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:36.219491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db2f1e-9c79-4d3e-a480-ccefe41053c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:36.220440 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db2f1e-9c79-4d3e-a480-ccefe41053c7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.220727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db2f1e-9c79-4d3e-a480-ccefe41053c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.221003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db2f1e-9c79-4d3e-a480-ccefe41053c7 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.222211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db2f1e-9c79-4d3e-a480-ccefe41053c7 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:36.224514 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db2f1e-9c79-4d3e-a480-ccefe41053c7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:36.226529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 184/373] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:36 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:36.227153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db2f1e-9c79-4d3e-a480-ccefe41053c7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:36.237366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 190/374] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:36.238702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d179-4fb0-449b-b929-f5f4f40e49ac None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.239066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d179-4fb0-449b-b929-f5f4f40e49ac None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.239385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d179-4fb0-449b-b929-f5f4f40e49ac None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.240762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 191/375] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:36.241463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d179-4fb0-449b-b929-f5f4f40e49ac None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:36.338041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:36.369306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db2f1e-9c79-4d3e-a480-ccefe41053c7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:36.385142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d179-4fb0-449b-b929-f5f4f40e49ac None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:36.424889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd4823-dbac-49b0-ada4-0aacbfc4758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:36.425866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd4823-dbac-49b0-ada4-0aacbfc4758d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.426221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd4823-dbac-49b0-ada4-0aacbfc4758d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.426610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd4823-dbac-49b0-ada4-0aacbfc4758d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.427767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd4823-dbac-49b0-ada4-0aacbfc4758d None admin] RBAC: Adding query filter params (group.id=630c7e3d248740239a5f563d64d25a50, role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=2a63d9b074144aa49bea1d60271c535e) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:36.428163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd4823-dbac-49b0-ada4-0aacbfc4758d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:36.429934 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd4823-dbac-49b0-ada4-0aacbfc4758d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:36.431569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a342b-6b73-482c-8b70-31520681a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:36.433542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a342b-6b73-482c-8b70-31520681a679 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.433542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a342b-6b73-482c-8b70-31520681a679 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.433542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a342b-6b73-482c-8b70-31520681a679 None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.434846 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a342b-6b73-482c-8b70-31520681a679 None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:36.436301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a342b-6b73-482c-8b70-31520681a679 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:36.438237 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 192/376] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:36 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:36.438534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 185/377] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:36 2022] GET /identity/v3/role_assignments?group.id=630c7e3d248740239a5f563d64d25a50&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:36.439256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a342b-6b73-482c-8b70-31520681a679 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:36.440021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdcf6c-0514-4c22-b3b3-c9a91ba1ef16 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.440217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdcf6c-0514-4c22-b3b3-c9a91ba1ef16 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.440500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdcf6c-0514-4c22-b3b3-c9a91ba1ef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.455299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:36.474902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5dbdcf6c-0514-4c22-b3b3-c9a91ba1ef16 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:36.477446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5dbdcf6c-0514-4c22-b3b3-c9a91ba1ef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:36.564772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 186/378] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:36.565710 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdcf6c-0514-4c22-b3b3-c9a91ba1ef16 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:36.574540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a342b-6b73-482c-8b70-31520681a679 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:36.622945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa59bf0-7ceb-4b90-bf2a-c3eb298f48be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:36.628887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa59bf0-7ceb-4b90-bf2a-c3eb298f48be None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.629402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa59bf0-7ceb-4b90-bf2a-c3eb298f48be None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.630025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa59bf0-7ceb-4b90-bf2a-c3eb298f48be None admin] PATH_INFO: `/v3/projects/fccb2b976d33488897e5b5707f7da2b4` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.636107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa59bf0-7ceb-4b90-bf2a-c3eb298f48be None admin] RBAC: Authorizing `identity:get_project(project_id=fccb2b976d33488897e5b5707f7da2b4)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:36.637798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa59bf0-7ceb-4b90-bf2a-c3eb298f48be None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:36.640165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 193/379] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:36 2022] GET /identity/v3/projects/fccb2b976d33488897e5b5707f7da2b4 => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:36.641104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa59bf0-7ceb-4b90-bf2a-c3eb298f48be None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:36.642548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:36.677152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdcf6c-0514-4c22-b3b3-c9a91ba1ef16 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:36.722964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c9205-9975-4e43-8dc1-8d48fff99365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:36.724444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c9205-9975-4e43-8dc1-8d48fff99365 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.725251 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c9205-9975-4e43-8dc1-8d48fff99365 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.725708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c9205-9975-4e43-8dc1-8d48fff99365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.726734 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c9205-9975-4e43-8dc1-8d48fff99365 None admin] RBAC: Adding query filter params (group.id=630c7e3d248740239a5f563d64d25a50, role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=2a63d9b074144aa49bea1d60271c535e) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:36.727456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c9205-9975-4e43-8dc1-8d48fff99365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:36.729701 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c9205-9975-4e43-8dc1-8d48fff99365 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:36.737024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 187/380] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:36 2022] GET /identity/v3/role_assignments?group.id=630c7e3d248740239a5f563d64d25a50&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:36.738705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c9205-9975-4e43-8dc1-8d48fff99365 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:36.746357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:36.784668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa59bf0-7ceb-4b90-bf2a-c3eb298f48be None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:36.823209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420cc7d-17e9-44e2-af0f-7de336255701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:36.824056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420cc7d-17e9-44e2-af0f-7de336255701 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.824345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420cc7d-17e9-44e2-af0f-7de336255701 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.824620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420cc7d-17e9-44e2-af0f-7de336255701 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.838526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420cc7d-17e9-44e2-af0f-7de336255701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-a420cc7d-17e9-44e2-af0f-7de336255701 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:36.846554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:36.847539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:36.848531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 194/381] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:36.854681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420cc7d-17e9-44e2-af0f-7de336255701 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:36.866316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c9205-9975-4e43-8dc1-8d48fff99365 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:36.905612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6790426-3f6e-4e19-8d98-3b0f694bc394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:36.906403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6790426-3f6e-4e19-8d98-3b0f694bc394 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:36.906684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6790426-3f6e-4e19-8d98-3b0f694bc394 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:36.907062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6790426-3f6e-4e19-8d98-3b0f694bc394 None admin] PATH_INFO: `/v3/groups/559a47542d364208bdd5044f8a61908e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:36.909543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:36.916986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6790426-3f6e-4e19-8d98-3b0f694bc394 None admin] RBAC: Authorizing `identity:get_group(group_id=559a47542d364208bdd5044f8a61908e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:36.918616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6790426-3f6e-4e19-8d98-3b0f694bc394 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:36.920845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 188/382] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:36 2022] GET /identity/v3/groups/559a47542d364208bdd5044f8a61908e => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:36.930115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6790426-3f6e-4e19-8d98-3b0f694bc394 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:36.979786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420cc7d-17e9-44e2-af0f-7de336255701 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:37.025197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ce44d-a741-433b-a65b-a66c82f0fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:37.025966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ce44d-a741-433b-a65b-a66c82f0fe81 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:37.026429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ce44d-a741-433b-a65b-a66c82f0fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:37.026711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ce44d-a741-433b-a65b-a66c82f0fe81 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:37.028149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ce44d-a741-433b-a65b-a66c82f0fe81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:37.028462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ce44d-a741-433b-a65b-a66c82f0fe81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:37.030182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ce44d-a741-433b-a65b-a66c82f0fe81 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:37.042147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:37.047665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 195/383] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:37.054555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ce44d-a741-433b-a65b-a66c82f0fe81 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:37.076859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6790426-3f6e-4e19-8d98-3b0f694bc394 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:37.120729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e0d68-f022-40fe-983d-eca089c7aaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:37.121922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0d68-f022-40fe-983d-eca089c7aaed None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:37.122225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0d68-f022-40fe-983d-eca089c7aaed None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:37.122511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0d68-f022-40fe-983d-eca089c7aaed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:37.125363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e0d68-f022-40fe-983d-eca089c7aaed None admin] RBAC: Adding query filter params (group.id=559a47542d364208bdd5044f8a61908e, role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=fccb2b976d33488897e5b5707f7da2b4) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:37.126151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e0d68-f022-40fe-983d-eca089c7aaed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:37.130118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e0d68-f022-40fe-983d-eca089c7aaed None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:37.139056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 189/384] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:36 2022] GET /identity/v3/role_assignments?group.id=559a47542d364208bdd5044f8a61908e&scope.project.id=fccb2b976d33488897e5b5707f7da2b4&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:37.208295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ce44d-a741-433b-a65b-a66c82f0fe81 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:37.261412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ff82e-04e2-49f0-a935-973fc085fa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:37.262295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ff82e-04e2-49f0-a935-973fc085fa2c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:37.262578 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ff82e-04e2-49f0-a935-973fc085fa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:37.262853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ff82e-04e2-49f0-a935-973fc085fa2c None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:37.265549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ff82e-04e2-49f0-a935-973fc085fa2c None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:37.267016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ff82e-04e2-49f0-a935-973fc085fa2c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:37.269107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 196/385] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:37 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:37.275667 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e0d68-f022-40fe-983d-eca089c7aaed None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:37.350836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:37.396571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e0d68-f022-40fe-983d-eca089c7aaed None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:37.433364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1f829-0024-4842-ac53-55b7e1e0438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:37.434240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1f829-0024-4842-ac53-55b7e1e0438e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:37.434525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1f829-0024-4842-ac53-55b7e1e0438e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:37.434804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1f829-0024-4842-ac53-55b7e1e0438e None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:37.436089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1f829-0024-4842-ac53-55b7e1e0438e None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:37.437611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1f829-0024-4842-ac53-55b7e1e0438e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:37.439357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 190/386] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:37 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:37.445981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ff82e-04e2-49f0-a935-973fc085fa2c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:37.525089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:37.563548 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ff82e-04e2-49f0-a935-973fc085fa2c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:37.614631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b302e-06f6-48c4-a7e3-b766d1bb67ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:37.615842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b302e-06f6-48c4-a7e3-b766d1bb67ea None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:37.616321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b302e-06f6-48c4-a7e3-b766d1bb67ea None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:37.616750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b302e-06f6-48c4-a7e3-b766d1bb67ea None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08/groups/630c7e3d248740239a5f563d64d25a50/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:37.620825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b302e-06f6-48c4-a7e3-b766d1bb67ea None admin] RBAC: Authorizing `identity:create_grant(project_id=18959bc99d074db3beb4a507e6e95b08, group_id=630c7e3d248740239a5f563d64d25a50, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:37.622540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b302e-06f6-48c4-a7e3-b766d1bb67ea None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:37.647481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 197/387] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 21:58:37 2022] PUT /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08/groups/630c7e3d248740239a5f563d64d25a50/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:37.849906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cc25c-c22d-4320-9e58-b2a131e1828f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:37.850424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cc25c-c22d-4320-9e58-b2a131e1828f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:37.850859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cc25c-c22d-4320-9e58-b2a131e1828f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:37.852707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 191/388] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:37.857971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f0d50-d928-4d42-9d42-52ab1322c9d4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:37.858484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f0d50-d928-4d42-9d42-52ab1322c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:37.858909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f0d50-d928-4d42-9d42-52ab1322c9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:37.885077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-919f0d50-d928-4d42-9d42-52ab1322c9d4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:37.886595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-919f0d50-d928-4d42-9d42-52ab1322c9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:37.968333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 198/389] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:37.991014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cc25c-c22d-4320-9e58-b2a131e1828f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:38.144595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cc25c-c22d-4320-9e58-b2a131e1828f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:38.202640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:38.209164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176168a7-9ac5-4b13-8071-7bfcbd4f61b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:38.210001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176168a7-9ac5-4b13-8071-7bfcbd4f61b5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:38.210293 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176168a7-9ac5-4b13-8071-7bfcbd4f61b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:38.210582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176168a7-9ac5-4b13-8071-7bfcbd4f61b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:38.228494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176168a7-9ac5-4b13-8071-7bfcbd4f61b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-176168a7-9ac5-4b13-8071-7bfcbd4f61b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:38.236863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:38.237733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:38.238515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:38.240348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 192/390] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:38.244518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f0d50-d928-4d42-9d42-52ab1322c9d4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:38.386045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:38.459734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f0d50-d928-4d42-9d42-52ab1322c9d4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:38.526467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977dfa5-47d4-4a88-8790-d237d3cb2d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:38.527149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977dfa5-47d4-4a88-8790-d237d3cb2d8b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:38.527433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977dfa5-47d4-4a88-8790-d237d3cb2d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:38.527710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977dfa5-47d4-4a88-8790-d237d3cb2d8b None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:38.528501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977dfa5-47d4-4a88-8790-d237d3cb2d8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:38.528808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977dfa5-47d4-4a88-8790-d237d3cb2d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:38.530175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977dfa5-47d4-4a88-8790-d237d3cb2d8b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:38.547296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 199/391] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:38.552827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176168a7-9ac5-4b13-8071-7bfcbd4f61b5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:38.705309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176168a7-9ac5-4b13-8071-7bfcbd4f61b5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:38.755598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9bba8-c5ab-4413-bc86-5fbcf4e26cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:38.761466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9bba8-c5ab-4413-bc86-5fbcf4e26cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:38.761761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9bba8-c5ab-4413-bc86-5fbcf4e26cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:38.762051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9bba8-c5ab-4413-bc86-5fbcf4e26cd9 None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:38.763388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9bba8-c5ab-4413-bc86-5fbcf4e26cd9 None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:38.767981 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9bba8-c5ab-4413-bc86-5fbcf4e26cd9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:38.769649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 193/392] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:38 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:38.778461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977dfa5-47d4-4a88-8790-d237d3cb2d8b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:38.924408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977dfa5-47d4-4a88-8790-d237d3cb2d8b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:38.955054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:38.972744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d96bb-620c-4322-9963-16e9ba3b5739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:38.973556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d96bb-620c-4322-9963-16e9ba3b5739 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:38.973838 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d96bb-620c-4322-9963-16e9ba3b5739 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:38.974115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d96bb-620c-4322-9963-16e9ba3b5739 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:38.980637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d96bb-620c-4322-9963-16e9ba3b5739 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:38.982100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d96bb-620c-4322-9963-16e9ba3b5739 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:38.984195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 200/393] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:38 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:38.988200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e905-4f1c-4b02-843b-49e88cf7e0ea None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:38.988724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e905-4f1c-4b02-843b-49e88cf7e0ea None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:38.989731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e905-4f1c-4b02-843b-49e88cf7e0ea None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:38.990085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d96bb-620c-4322-9963-16e9ba3b5739 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:38.995735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 194/394] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:38.997284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98584586-aea1-4f20-90c9-09c1d2aea9c5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:38.997791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98584586-aea1-4f20-90c9-09c1d2aea9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:38.998267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98584586-aea1-4f20-90c9-09c1d2aea9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:39.017434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-98584586-aea1-4f20-90c9-09c1d2aea9c5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:39.019117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-98584586-aea1-4f20-90c9-09c1d2aea9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:39.147834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:39.158598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d96bb-620c-4322-9963-16e9ba3b5739 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:39.197924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e46a66-c504-4244-bbcd-836a505fa82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:39.198964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e46a66-c504-4244-bbcd-836a505fa82b None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:39.199362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e46a66-c504-4244-bbcd-836a505fa82b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:39.199759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e46a66-c504-4244-bbcd-836a505fa82b None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08/groups/630c7e3d248740239a5f563d64d25a50/roles/61fdd4e4d3c546ec97b97285ad1f80cd` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:39.200006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 195/395] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:39.202345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e46a66-c504-4244-bbcd-836a505fa82b None admin] RBAC: Authorizing `identity:create_grant(project_id=18959bc99d074db3beb4a507e6e95b08, group_id=630c7e3d248740239a5f563d64d25a50, role_id=61fdd4e4d3c546ec97b97285ad1f80cd)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:39.203919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e46a66-c504-4244-bbcd-836a505fa82b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:39.218168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 201/396] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 21:58:38 2022] PUT /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08/groups/630c7e3d248740239a5f563d64d25a50/roles/61fdd4e4d3c546ec97b97285ad1f80cd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 21:58:39.239492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98584586-aea1-4f20-90c9-09c1d2aea9c5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:39.390441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98584586-aea1-4f20-90c9-09c1d2aea9c5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:39.433011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c8571-a515-4f20-99ed-552c6be21c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:39.433813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8571-a515-4f20-99ed-552c6be21c8d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:39.434097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8571-a515-4f20-99ed-552c6be21c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:39.434372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8571-a515-4f20-99ed-552c6be21c8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:39.445788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c8571-a515-4f20-99ed-552c6be21c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-877c8571-a515-4f20-99ed-552c6be21c8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:39.453767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:39.454692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:39.456232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 196/397] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:39.461937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e46a66-c504-4244-bbcd-836a505fa82b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:39.527141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:39.581836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43802e05-16ba-42eb-a0de-45823cbe1bf6 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:39.582166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43802e05-16ba-42eb-a0de-45823cbe1bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:39.582422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43802e05-16ba-42eb-a0de-45823cbe1bf6 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:39.586504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 197/398] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:58:39.593000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dd4b8-6266-4184-94ef-38377c90dc1f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:39.593294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dd4b8-6266-4184-94ef-38377c90dc1f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:39.593586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dd4b8-6266-4184-94ef-38377c90dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:39.608064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e46a66-c504-4244-bbcd-836a505fa82b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:39.633200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0a3dd4b8-6266-4184-94ef-38377c90dc1f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:39.634415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0a3dd4b8-6266-4184-94ef-38377c90dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:39.654001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed3f12-3f28-4801-9e83-82e1ab1e11f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:39.654922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed3f12-3f28-4801-9e83-82e1ab1e11f1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:39.655388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed3f12-3f28-4801-9e83-82e1ab1e11f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:39.655826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed3f12-3f28-4801-9e83-82e1ab1e11f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:39.656931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed3f12-3f28-4801-9e83-82e1ab1e11f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:39.657404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed3f12-3f28-4801-9e83-82e1ab1e11f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:39.659176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed3f12-3f28-4801-9e83-82e1ab1e11f1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:39.670904 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 202/399] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:39.679931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed3f12-3f28-4801-9e83-82e1ab1e11f1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:39.720310 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:39.765737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 198/400] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:39.788241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dd4b8-6266-4184-94ef-38377c90dc1f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:39.913859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed3f12-3f28-4801-9e83-82e1ab1e11f1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:39.924471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dd4b8-6266-4184-94ef-38377c90dc1f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:39.930091 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:39.955977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9715-2eab-494f-9b32-3bb1c886388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:39.956849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9715-2eab-494f-9b32-3bb1c886388d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:39.957135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9715-2eab-494f-9b32-3bb1c886388d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:39.957955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9715-2eab-494f-9b32-3bb1c886388d None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:39.959414 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a9715-2eab-494f-9b32-3bb1c886388d None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:39.960885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a9715-2eab-494f-9b32-3bb1c886388d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:39.962824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 203/401] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:39 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:39.968095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9715-2eab-494f-9b32-3bb1c886388d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:39.988277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405ade1-f83f-4fc0-83d0-85494af9232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:39.989218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405ade1-f83f-4fc0-83d0-85494af9232b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:39.989808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405ade1-f83f-4fc0-83d0-85494af9232b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:39.989808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405ade1-f83f-4fc0-83d0-85494af9232b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.010199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405ade1-f83f-4fc0-83d0-85494af9232b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2405ade1-f83f-4fc0-83d0-85494af9232b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:40.024810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:40.025782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:40.026573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:40.031938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 199/402] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:40.033656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405ade1-f83f-4fc0-83d0-85494af9232b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:40.073362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9715-2eab-494f-9b32-3bb1c886388d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:40.116104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f24034-6dbc-42c0-b194-29a9ef7f8ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:40.117018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f24034-6dbc-42c0-b194-29a9ef7f8ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.117311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f24034-6dbc-42c0-b194-29a9ef7f8ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.117636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f24034-6dbc-42c0-b194-29a9ef7f8ce6 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.118849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f24034-6dbc-42c0-b194-29a9ef7f8ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:40.120728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f24034-6dbc-42c0-b194-29a9ef7f8ce6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:40.121277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:40.123747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 204/403] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:39 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:40.128909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f24034-6dbc-42c0-b194-29a9ef7f8ce6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:40.225870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:40.237588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405ade1-f83f-4fc0-83d0-85494af9232b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:40.294581 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efb7b8-925e-47c2-9f8a-14a8c31c8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:40.295263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efb7b8-925e-47c2-9f8a-14a8c31c8c42 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.295551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efb7b8-925e-47c2-9f8a-14a8c31c8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.295830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efb7b8-925e-47c2-9f8a-14a8c31c8c42 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.296628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efb7b8-925e-47c2-9f8a-14a8c31c8c42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:40.296939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efb7b8-925e-47c2-9f8a-14a8c31c8c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:40.298316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efb7b8-925e-47c2-9f8a-14a8c31c8c42 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:40.315065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 200/404] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:40.322053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efb7b8-925e-47c2-9f8a-14a8c31c8c42 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:40.338467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f24034-6dbc-42c0-b194-29a9ef7f8ce6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:40.404946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c340f57-c4da-4fc2-94aa-3d7dbfefce3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:40.406114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c340f57-c4da-4fc2-94aa-3d7dbfefce3a None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.406650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c340f57-c4da-4fc2-94aa-3d7dbfefce3a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.407077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c340f57-c4da-4fc2-94aa-3d7dbfefce3a None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e/groups/630c7e3d248740239a5f563d64d25a50/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.409433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c340f57-c4da-4fc2-94aa-3d7dbfefce3a None admin] RBAC: Authorizing `identity:create_grant(project_id=2a63d9b074144aa49bea1d60271c535e, group_id=630c7e3d248740239a5f563d64d25a50, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:40.411527 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c340f57-c4da-4fc2-94aa-3d7dbfefce3a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:40.428568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 205/405] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 21:58:40 2022] PUT /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e/groups/630c7e3d248740239a5f563d64d25a50/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:40.429817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee5888-a7b6-4e4d-9242-21e33f37415f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.430109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee5888-a7b6-4e4d-9242-21e33f37415f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.430384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee5888-a7b6-4e4d-9242-21e33f37415f None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.432031 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 206/406] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:40.446006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142380-90ac-4a45-9c14-8563d56ecb7c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.446332 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142380-90ac-4a45-9c14-8563d56ecb7c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.446568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142380-90ac-4a45-9c14-8563d56ecb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.475838 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-32142380-90ac-4a45-9c14-8563d56ecb7c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:40.477088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-32142380-90ac-4a45-9c14-8563d56ecb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:40.495807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:40.499357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efb7b8-925e-47c2-9f8a-14a8c31c8c42 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:40.570948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ce289-49a0-41ef-bc71-c7cbdddba39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:40.572247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ce289-49a0-41ef-bc71-c7cbdddba39a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.572740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ce289-49a0-41ef-bc71-c7cbdddba39a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.573254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ce289-49a0-41ef-bc71-c7cbdddba39a None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.574746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ce289-49a0-41ef-bc71-c7cbdddba39a None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:40.576599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ce289-49a0-41ef-bc71-c7cbdddba39a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:40.580061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 201/407] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:40 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:40.586634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ce289-49a0-41ef-bc71-c7cbdddba39a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:40.622692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 207/408] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:40.624381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cb245-58a0-4fb1-88c9-ed8882ff8ea9 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.624895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cb245-58a0-4fb1-88c9-ed8882ff8ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.625409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cb245-58a0-4fb1-88c9-ed8882ff8ea9 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.626936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 208/409] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:40.633436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8d2a9-27c6-48c0-b79c-203b1bd943aa None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.633982 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8d2a9-27c6-48c0-b79c-203b1bd943aa None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.634468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8d2a9-27c6-48c0-b79c-203b1bd943aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.652479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e1f8d2a9-27c6-48c0-b79c-203b1bd943aa None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:40.653998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e1f8d2a9-27c6-48c0-b79c-203b1bd943aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:40.685945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:40.713577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ce289-49a0-41ef-bc71-c7cbdddba39a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:40.731039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 209/410] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:40.732331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8d2a9-27c6-48c0-b79c-203b1bd943aa None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:40.748551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd91e7b-d9d5-4377-904e-272cd71db377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:40.749428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd91e7b-d9d5-4377-904e-272cd71db377 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.749717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd91e7b-d9d5-4377-904e-272cd71db377 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.749999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd91e7b-d9d5-4377-904e-272cd71db377 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.751422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd91e7b-d9d5-4377-904e-272cd71db377 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:40.752938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd91e7b-d9d5-4377-904e-272cd71db377 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:40.755891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 202/411] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:40 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:40.764814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd91e7b-d9d5-4377-904e-272cd71db377 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:40.804275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:40.842052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8d2a9-27c6-48c0-b79c-203b1bd943aa None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:40.874352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd91e7b-d9d5-4377-904e-272cd71db377 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:40.880532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c7ebf-e53a-49c9-89dd-72862138a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:40.881611 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c7ebf-e53a-49c9-89dd-72862138a270 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.882100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c7ebf-e53a-49c9-89dd-72862138a270 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.882595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c7ebf-e53a-49c9-89dd-72862138a270 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.895325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c7ebf-e53a-49c9-89dd-72862138a270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4c0c7ebf-e53a-49c9-89dd-72862138a270 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:40.903362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:40.904287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:40.905078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:40.907702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 210/412] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:58:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:40.908817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c7ebf-e53a-49c9-89dd-72862138a270 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:40.915680 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d20e-7fe6-4ef3-b1ff-5a2c5a176a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:40.916616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d20e-7fe6-4ef3-b1ff-5a2c5a176a7f None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:40.916904 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d20e-7fe6-4ef3-b1ff-5a2c5a176a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:40.917185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d20e-7fe6-4ef3-b1ff-5a2c5a176a7f None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e/groups/630c7e3d248740239a5f563d64d25a50/roles/61fdd4e4d3c546ec97b97285ad1f80cd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:40.919978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5d20e-7fe6-4ef3-b1ff-5a2c5a176a7f None admin] RBAC: Authorizing `identity:create_grant(project_id=2a63d9b074144aa49bea1d60271c535e, group_id=630c7e3d248740239a5f563d64d25a50, role_id=61fdd4e4d3c546ec97b97285ad1f80cd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:40.921457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5d20e-7fe6-4ef3-b1ff-5a2c5a176a7f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:40.937880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 203/413] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 21:58:40 2022] PUT /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e/groups/630c7e3d248740239a5f563d64d25a50/roles/61fdd4e4d3c546ec97b97285ad1f80cd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:40.939097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d20e-7fe6-4ef3-b1ff-5a2c5a176a7f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:40.948883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:41.045484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c7ebf-e53a-49c9-89dd-72862138a270 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:41.075407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:41.086288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d20e-7fe6-4ef3-b1ff-5a2c5a176a7f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:41.091326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cbc5c-e61c-4f06-9f54-17b32f1ad998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:41.092472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cbc5c-e61c-4f06-9f54-17b32f1ad998 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:41.092984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cbc5c-e61c-4f06-9f54-17b32f1ad998 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:41.093451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cbc5c-e61c-4f06-9f54-17b32f1ad998 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:41.116697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cbc5c-e61c-4f06-9f54-17b32f1ad998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:41.127936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d464a-f976-4c46-9297-52f88b9a82c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:41.128525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d464a-f976-4c46-9297-52f88b9a82c3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:41.128817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d464a-f976-4c46-9297-52f88b9a82c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-155cbc5c-e61c-4f06-9f54-17b32f1ad998 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:41.129026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:41.130094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:41.130922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:41.131512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d464a-f976-4c46-9297-52f88b9a82c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:41.131512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d464a-f976-4c46-9297-52f88b9a82c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:41.131512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d464a-f976-4c46-9297-52f88b9a82c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:41.132259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d464a-f976-4c46-9297-52f88b9a82c3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:41.134943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 211/414] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:41.143388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cbc5c-e61c-4f06-9f54-17b32f1ad998 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:41.154005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 204/415] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:41.159803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d464a-f976-4c46-9297-52f88b9a82c3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:41.280511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:41.295706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d464a-f976-4c46-9297-52f88b9a82c3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:41.298729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cbc5c-e61c-4f06-9f54-17b32f1ad998 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:41.340301 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a7862-55e2-4580-9acb-95c02f304013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:41.341467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a7862-55e2-4580-9acb-95c02f304013 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:41.341754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a7862-55e2-4580-9acb-95c02f304013 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:41.342038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a7862-55e2-4580-9acb-95c02f304013 None admin] PATH_INFO: `/v3/groups/559a47542d364208bdd5044f8a61908e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:41.343490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a7862-55e2-4580-9acb-95c02f304013 None admin] RBAC: Authorizing `identity:get_group(group_id=559a47542d364208bdd5044f8a61908e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:41.344971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a7862-55e2-4580-9acb-95c02f304013 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:41.346923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 205/416] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:41 2022] GET /identity/v3/groups/559a47542d364208bdd5044f8a61908e => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:41.347039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b754-d633-41c4-bdd3-c71d81f56f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:41.347970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b754-d633-41c4-bdd3-c71d81f56f1f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:41.349006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b754-d633-41c4-bdd3-c71d81f56f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:41.349479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b754-d633-41c4-bdd3-c71d81f56f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:41.350433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7b754-d633-41c4-bdd3-c71d81f56f1f None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:41.350951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7b754-d633-41c4-bdd3-c71d81f56f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:41.352837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7b754-d633-41c4-bdd3-c71d81f56f1f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:41.353083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a7862-55e2-4580-9acb-95c02f304013 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:41.373449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 212/417] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:41.378726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b754-d633-41c4-bdd3-c71d81f56f1f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:41.418452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:41.514136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b754-d633-41c4-bdd3-c71d81f56f1f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:41.550152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a7862-55e2-4580-9acb-95c02f304013 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:41.570854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420084d4-5383-442d-a51d-32989c8f41ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:41.571885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420084d4-5383-442d-a51d-32989c8f41ae None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:41.572380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420084d4-5383-442d-a51d-32989c8f41ae None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:41.572840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420084d4-5383-442d-a51d-32989c8f41ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:41.587657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf5ba1-7111-49f7-b2a7-ac4260c852be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:41.588563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf5ba1-7111-49f7-b2a7-ac4260c852be None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:41.588845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf5ba1-7111-49f7-b2a7-ac4260c852be None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:41.589120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf5ba1-7111-49f7-b2a7-ac4260c852be None admin] PATH_INFO: `/v3/projects/fccb2b976d33488897e5b5707f7da2b4` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:41.590307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf5ba1-7111-49f7-b2a7-ac4260c852be None admin] RBAC: Authorizing `identity:get_project(project_id=fccb2b976d33488897e5b5707f7da2b4)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:41.591732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf5ba1-7111-49f7-b2a7-ac4260c852be None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:41.593864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 206/418] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:41 2022] GET /identity/v3/projects/fccb2b976d33488897e5b5707f7da2b4 => generated 344 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:41.599928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccd1e9-456c-4fd5-a68f-e127b4f5d0df None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:41.599928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccd1e9-456c-4fd5-a68f-e127b4f5d0df None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:41.599928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccd1e9-456c-4fd5-a68f-e127b4f5d0df None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:41.602708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 207/419] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:41.605149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:41.605808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233ef28-20c7-4054-bf8e-f3bbe02d773d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:41.606178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233ef28-20c7-4054-bf8e-f3bbe02d773d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:41.606379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233ef28-20c7-4054-bf8e-f3bbe02d773d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:41.624525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d233ef28-20c7-4054-bf8e-f3bbe02d773d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:41.625727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d233ef28-20c7-4054-bf8e-f3bbe02d773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:41.666608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420084d4-5383-442d-a51d-32989c8f41ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:41.668513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420084d4-5383-442d-a51d-32989c8f41ae None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:41.704127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 208/420] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:41.704916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233ef28-20c7-4054-bf8e-f3bbe02d773d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:41.742874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:41.787208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 213/421] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:41.792915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420084d4-5383-442d-a51d-32989c8f41ae None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:41.825427 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233ef28-20c7-4054-bf8e-f3bbe02d773d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:41.849339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:41.861562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950af9a8-d019-482d-a126-2a85a11f1c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:41.862590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950af9a8-d019-482d-a126-2a85a11f1c6c None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:41.862873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950af9a8-d019-482d-a126-2a85a11f1c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:41.863146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950af9a8-d019-482d-a126-2a85a11f1c6c None admin] PATH_INFO: `/v3/projects/fccb2b976d33488897e5b5707f7da2b4/groups/559a47542d364208bdd5044f8a61908e/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:41.866041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950af9a8-d019-482d-a126-2a85a11f1c6c None admin] RBAC: Authorizing `identity:create_grant(project_id=fccb2b976d33488897e5b5707f7da2b4, group_id=559a47542d364208bdd5044f8a61908e, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:41.867586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950af9a8-d019-482d-a126-2a85a11f1c6c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:41.887944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 209/422] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 21:58:41 2022] PUT /identity/v3/projects/fccb2b976d33488897e5b5707f7da2b4/groups/559a47542d364208bdd5044f8a61908e/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:58:41.887944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950af9a8-d019-482d-a126-2a85a11f1c6c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:41.938937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420084d4-5383-442d-a51d-32989c8f41ae None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:41.980541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:41.997254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950af9a8-d019-482d-a126-2a85a11f1c6c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:42.021425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340bdf-2d33-4a40-a5aa-43755bb6ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:42.022746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340bdf-2d33-4a40-a5aa-43755bb6ce4e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:42.023262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340bdf-2d33-4a40-a5aa-43755bb6ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:42.023742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340bdf-2d33-4a40-a5aa-43755bb6ce4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:42.046253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a085a90-75bd-40be-868a-8d58a290a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:42.047129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085a90-75bd-40be-868a-8d58a290a621 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:42.047409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085a90-75bd-40be-868a-8d58a290a621 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:42.047682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085a90-75bd-40be-868a-8d58a290a621 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:42.048613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3340bdf-2d33-4a40-a5aa-43755bb6ce4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:42.052963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a085a90-75bd-40be-868a-8d58a290a621 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:42.057181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a085a90-75bd-40be-868a-8d58a290a621 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:42.061295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 210/423] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:41 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c3340bdf-2d33-4a40-a5aa-43755bb6ce4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:42.063076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:42.063968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:42.064757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 214/424] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:42.069123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a085a90-75bd-40be-868a-8d58a290a621 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:42.076176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340bdf-2d33-4a40-a5aa-43755bb6ce4e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:42.191093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a085a90-75bd-40be-868a-8d58a290a621 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:42.229949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015e5a2-0f73-4754-aebd-f89c814b4a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:42.230817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015e5a2-0f73-4754-aebd-f89c814b4a18 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:42.231030 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340bdf-2d33-4a40-a5aa-43755bb6ce4e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:42.231133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015e5a2-0f73-4754-aebd-f89c814b4a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:42.231363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015e5a2-0f73-4754-aebd-f89c814b4a18 None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:42.233588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015e5a2-0f73-4754-aebd-f89c814b4a18 None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:42.235163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015e5a2-0f73-4754-aebd-f89c814b4a18 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:42.236872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 211/425] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:42 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:42.242823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:42.244621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015e5a2-0f73-4754-aebd-f89c814b4a18 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:42.270104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:42.283450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce634d-c31d-45e1-ad38-968508201b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:42.284495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce634d-c31d-45e1-ad38-968508201b36 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:42.284968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce634d-c31d-45e1-ad38-968508201b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:42.286022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce634d-c31d-45e1-ad38-968508201b36 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:42.287604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce634d-c31d-45e1-ad38-968508201b36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:42.288167 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce634d-c31d-45e1-ad38-968508201b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:42.289749 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce634d-c31d-45e1-ad38-968508201b36 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:42.309038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 215/426] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:42.314370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce634d-c31d-45e1-ad38-968508201b36 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:42.360110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015e5a2-0f73-4754-aebd-f89c814b4a18 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:42.397745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474c92e-09b7-4e20-af7b-337a9dabc2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:42.398408 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474c92e-09b7-4e20-af7b-337a9dabc2dc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:42.398743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474c92e-09b7-4e20-af7b-337a9dabc2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:42.399026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474c92e-09b7-4e20-af7b-337a9dabc2dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:42.399866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474c92e-09b7-4e20-af7b-337a9dabc2dc None admin] RBAC: Adding query filter params (group.id=630c7e3d248740239a5f563d64d25a50, role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=18959bc99d074db3beb4a507e6e95b08) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:42.400229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474c92e-09b7-4e20-af7b-337a9dabc2dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:42.401790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474c92e-09b7-4e20-af7b-337a9dabc2dc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:42.408280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 212/427] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:42 2022] GET /identity/v3/role_assignments?group.id=630c7e3d248740239a5f563d64d25a50&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:42.520176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce634d-c31d-45e1-ad38-968508201b36 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:42.569675 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a899b9-ecf9-492f-a416-a1fa1837dd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:42.570338 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a899b9-ecf9-492f-a416-a1fa1837dd15 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:42.570622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a899b9-ecf9-492f-a416-a1fa1837dd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:42.570903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a899b9-ecf9-492f-a416-a1fa1837dd15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:42.625013 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:42.668501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a899b9-ecf9-492f-a416-a1fa1837dd15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:42.669959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a899b9-ecf9-492f-a416-a1fa1837dd15 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:42.810185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 216/428] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 21:58:42.815686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474c92e-09b7-4e20-af7b-337a9dabc2dc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:42.909681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:42.928268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b84b54-49c0-4199-a099-d5565daed1e8 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:42.928622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b84b54-49c0-4199-a099-d5565daed1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:42.929260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b84b54-49c0-4199-a099-d5565daed1e8 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:42.931865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474c92e-09b7-4e20-af7b-337a9dabc2dc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:42.936268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 217/429] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:42.937665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e269fa-1d70-4793-803b-622fbc989362 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:42.937955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e269fa-1d70-4793-803b-622fbc989362 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:42.938242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e269fa-1d70-4793-803b-622fbc989362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:42.964890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-77e269fa-1d70-4793-803b-622fbc989362 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:42.972628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-77e269fa-1d70-4793-803b-622fbc989362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:42.993240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00ce6-631b-4ef5-980e-7c10fdb245a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:42.994132 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00ce6-631b-4ef5-980e-7c10fdb245a7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:42.994424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00ce6-631b-4ef5-980e-7c10fdb245a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:42.994707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00ce6-631b-4ef5-980e-7c10fdb245a7 None admin] PATH_INFO: `/v3/projects/18959bc99d074db3beb4a507e6e95b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:42.996149 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a00ce6-631b-4ef5-980e-7c10fdb245a7 None admin] RBAC: Authorizing `identity:get_project(project_id=18959bc99d074db3beb4a507e6e95b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:42.997787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a00ce6-631b-4ef5-980e-7c10fdb245a7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:42.999752 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 213/430] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:42 2022] GET /identity/v3/projects/18959bc99d074db3beb4a507e6e95b08 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:43.007331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00ce6-631b-4ef5-980e-7c10fdb245a7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:43.066388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:43.075571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 218/431] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:43.105391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e269fa-1d70-4793-803b-622fbc989362 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:43.168981 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00ce6-631b-4ef5-980e-7c10fdb245a7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:43.226653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040ef8-36d3-4186-97e9-f1f35e78c14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:43.227533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040ef8-36d3-4186-97e9-f1f35e78c14d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:43.227818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040ef8-36d3-4186-97e9-f1f35e78c14d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:43.228161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040ef8-36d3-4186-97e9-f1f35e78c14d None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:43.229382 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b040ef8-36d3-4186-97e9-f1f35e78c14d None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:43.231452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b040ef8-36d3-4186-97e9-f1f35e78c14d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:43.234466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 214/432] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:43 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:43.241609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040ef8-36d3-4186-97e9-f1f35e78c14d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:43.265612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e269fa-1d70-4793-803b-622fbc989362 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:43.282906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:43.322433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff0a4-e29a-4628-81de-24ef62a010a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:43.323669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff0a4-e29a-4628-81de-24ef62a010a5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:43.324256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff0a4-e29a-4628-81de-24ef62a010a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:43.324735 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff0a4-e29a-4628-81de-24ef62a010a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:43.338643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eff0a4-e29a-4628-81de-24ef62a010a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-49eff0a4-e29a-4628-81de-24ef62a010a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:43.348883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:43.349824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 21:58:43.350653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:43.353447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 219/433] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:43.361489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff0a4-e29a-4628-81de-24ef62a010a5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:43.393059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040ef8-36d3-4186-97e9-f1f35e78c14d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:43.438224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:43.453742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c1f58-f9a2-4ae1-828a-e9a32e6c71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:43.454903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1f58-f9a2-4ae1-828a-e9a32e6c71b8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:43.454903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1f58-f9a2-4ae1-828a-e9a32e6c71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:43.455074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1f58-f9a2-4ae1-828a-e9a32e6c71b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:43.455798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c1f58-f9a2-4ae1-828a-e9a32e6c71b8 None admin] RBAC: Adding query filter params (group.id=630c7e3d248740239a5f563d64d25a50, role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=18959bc99d074db3beb4a507e6e95b08) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:43.456139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c1f58-f9a2-4ae1-828a-e9a32e6c71b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:43.462250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c1f58-f9a2-4ae1-828a-e9a32e6c71b8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:43.467432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 215/434] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:43 2022] GET /identity/v3/role_assignments?group.id=630c7e3d248740239a5f563d64d25a50&scope.project.id=18959bc99d074db3beb4a507e6e95b08&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:43.474167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b5f1-1838-4f52-b792-4914c00a3aaf None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:43.474351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b5f1-1838-4f52-b792-4914c00a3aaf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:43.474617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b5f1-1838-4f52-b792-4914c00a3aaf None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:43.477452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 216/435] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:43.483062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb06255-4e38-4ea8-8394-2fd3d95769a0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:43.484055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb06255-4e38-4ea8-8394-2fd3d95769a0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:43.484055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb06255-4e38-4ea8-8394-2fd3d95769a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:43.503378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff0a4-e29a-4628-81de-24ef62a010a5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:43.517274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6eb06255-4e38-4ea8-8394-2fd3d95769a0 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:43.518656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6eb06255-4e38-4ea8-8394-2fd3d95769a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:43.556621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8c079-1979-4a1e-a906-21bf744e861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:43.559209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8c079-1979-4a1e-a906-21bf744e861a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:43.560064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8c079-1979-4a1e-a906-21bf744e861a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:43.560800 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8c079-1979-4a1e-a906-21bf744e861a None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:43.562413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8c079-1979-4a1e-a906-21bf744e861a None admin] RBAC: Adding query filter params (name=member) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:43.563098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8c079-1979-4a1e-a906-21bf744e861a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:43.565683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8c079-1979-4a1e-a906-21bf744e861a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:43.578070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 220/436] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:43.585323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8c079-1979-4a1e-a906-21bf744e861a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:43.616204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 217/437] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:43.641673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb06255-4e38-4ea8-8394-2fd3d95769a0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:43.659997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:43.727817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8c079-1979-4a1e-a906-21bf744e861a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:43.762757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:43.776126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0491e-1e2a-43e0-8f67-da5aac586365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:43.777103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0491e-1e2a-43e0-8f67-da5aac586365 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:43.777389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0491e-1e2a-43e0-8f67-da5aac586365 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:43.777669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0491e-1e2a-43e0-8f67-da5aac586365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:43.789785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb06255-4e38-4ea8-8394-2fd3d95769a0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:43.839326 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553833a7-316f-4836-8b63-82c4b5920843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:43.840471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553833a7-316f-4836-8b63-82c4b5920843 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:43.840756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553833a7-316f-4836-8b63-82c4b5920843 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:43.841032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553833a7-316f-4836-8b63-82c4b5920843 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:43.852879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553833a7-316f-4836-8b63-82c4b5920843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:43.861078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0491e-1e2a-43e0-8f67-da5aac586365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:43.862555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0491e-1e2a-43e0-8f67-da5aac586365 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-553833a7-316f-4836-8b63-82c4b5920843 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:43.862762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:43.864193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:43.865003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:43.865599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 218/438] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:43.872873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553833a7-316f-4836-8b63-82c4b5920843 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:43.975587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:43.986822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 221/439] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:43.993566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0491e-1e2a-43e0-8f67-da5aac586365 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:44.005793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553833a7-316f-4836-8b63-82c4b5920843 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:44.024908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:44.048186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6f2a1-a327-40b6-a600-b97d0d1f73a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:44.048871 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6f2a1-a327-40b6-a600-b97d0d1f73a8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.049392 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6f2a1-a327-40b6-a600-b97d0d1f73a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.049674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6f2a1-a327-40b6-a600-b97d0d1f73a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.050804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6f2a1-a327-40b6-a600-b97d0d1f73a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:44.051771 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6f2a1-a327-40b6-a600-b97d0d1f73a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:44.053105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6f2a1-a327-40b6-a600-b97d0d1f73a8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:44.063755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 219/440] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:44.069360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6f2a1-a327-40b6-a600-b97d0d1f73a8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:44.108269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0491e-1e2a-43e0-8f67-da5aac586365 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:44.143996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a64a-c0c5-43c1-8aaf-1529d2d1f0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:44.145413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a64a-c0c5-43c1-8aaf-1529d2d1f0ad None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.145699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a64a-c0c5-43c1-8aaf-1529d2d1f0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.145974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a64a-c0c5-43c1-8aaf-1529d2d1f0ad None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.147178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1a64a-c0c5-43c1-8aaf-1529d2d1f0ad None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:44.148620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1a64a-c0c5-43c1-8aaf-1529d2d1f0ad None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:44.150311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 222/441] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:43 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:44.155484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a64a-c0c5-43c1-8aaf-1529d2d1f0ad None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:44.186548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6f2a1-a327-40b6-a600-b97d0d1f73a8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:44.223647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c367d-41f2-4105-8252-bc26e98ce376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:44.224624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c367d-41f2-4105-8252-bc26e98ce376 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.224912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c367d-41f2-4105-8252-bc26e98ce376 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.225199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c367d-41f2-4105-8252-bc26e98ce376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.229845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:44.250728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:44.262258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a64a-c0c5-43c1-8aaf-1529d2d1f0ad None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:44.298882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1dd5b-f661-420a-afe9-695f8f07bc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:44.299727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1dd5b-f661-420a-afe9-695f8f07bc27 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.300052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1dd5b-f661-420a-afe9-695f8f07bc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.300335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1dd5b-f661-420a-afe9-695f8f07bc27 None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.302051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1dd5b-f661-420a-afe9-695f8f07bc27 None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:44.303609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1dd5b-f661-420a-afe9-695f8f07bc27 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:44.305713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 223/442] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:44 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:44.310959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1dd5b-f661-420a-afe9-695f8f07bc27 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:44.311301 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c367d-41f2-4105-8252-bc26e98ce376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:44.312692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c367d-41f2-4105-8252-bc26e98ce376 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:44.413351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 220/443] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 21:58:44.418806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c367d-41f2-4105-8252-bc26e98ce376 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:44.419805 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1dd5b-f661-420a-afe9-695f8f07bc27 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:44.456716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a3784-a8b7-4336-911c-5ca6e6352624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:44.457424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a3784-a8b7-4336-911c-5ca6e6352624 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.457919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a3784-a8b7-4336-911c-5ca6e6352624 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.458113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a3784-a8b7-4336-911c-5ca6e6352624 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.458994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:44.459169 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a3784-a8b7-4336-911c-5ca6e6352624 None admin] RBAC: Adding query filter params (group.id=630c7e3d248740239a5f563d64d25a50, role.id=edfcc7d2aec44b54ab2c3f4809908b08, scope.project.id=2a63d9b074144aa49bea1d60271c535e) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:44.459481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a3784-a8b7-4336-911c-5ca6e6352624 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:44.460970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a3784-a8b7-4336-911c-5ca6e6352624 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:44.467133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 224/444] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:44 2022] GET /identity/v3/role_assignments?group.id=630c7e3d248740239a5f563d64d25a50&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=edfcc7d2aec44b54ab2c3f4809908b08 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:44.547580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c367d-41f2-4105-8252-bc26e98ce376 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:44.570863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a79ff-afe9-4b69-848b-1a6936f8cbf9 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.571397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a79ff-afe9-4b69-848b-1a6936f8cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.571397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a79ff-afe9-4b69-848b-1a6936f8cbf9 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.572837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 225/445] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:58:44.578399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f69d1-538e-4719-9a3c-2dedc687459f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.578692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f69d1-538e-4719-9a3c-2dedc687459f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.578983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f69d1-538e-4719-9a3c-2dedc687459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.587737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f07c6-6818-4e83-bf62-1afeda2eb346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:44.588967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f07c6-6818-4e83-bf62-1afeda2eb346 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.589430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f07c6-6818-4e83-bf62-1afeda2eb346 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.589915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f07c6-6818-4e83-bf62-1afeda2eb346 None admin] PATH_INFO: `/v3/projects/2a63d9b074144aa49bea1d60271c535e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.591422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f07c6-6818-4e83-bf62-1afeda2eb346 None admin] RBAC: Authorizing `identity:get_project(project_id=2a63d9b074144aa49bea1d60271c535e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:44.593088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f07c6-6818-4e83-bf62-1afeda2eb346 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:44.594989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 221/446] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:44 2022] GET /identity/v3/projects/2a63d9b074144aa49bea1d60271c535e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:44.600919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d23f69d1-538e-4719-9a3c-2dedc687459f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:44.601115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f07c6-6818-4e83-bf62-1afeda2eb346 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:44.602154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d23f69d1-538e-4719-9a3c-2dedc687459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:44.621755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:44.684153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 226/447] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:44.708786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f69d1-538e-4719-9a3c-2dedc687459f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:44.723365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f07c6-6818-4e83-bf62-1afeda2eb346 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:44.726697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:44.769302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db3e6a-af4b-4490-a094-27ac541eeae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:44.770728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db3e6a-af4b-4490-a094-27ac541eeae3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.771013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db3e6a-af4b-4490-a094-27ac541eeae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.771291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db3e6a-af4b-4490-a094-27ac541eeae3 None admin] PATH_INFO: `/v3/groups/630c7e3d248740239a5f563d64d25a50` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.772532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db3e6a-af4b-4490-a094-27ac541eeae3 None admin] RBAC: Authorizing `identity:get_group(group_id=630c7e3d248740239a5f563d64d25a50)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:44.773969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db3e6a-af4b-4490-a094-27ac541eeae3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:44.775616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 222/448] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:44 2022] GET /identity/v3/groups/630c7e3d248740239a5f563d64d25a50 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:44.781452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db3e6a-af4b-4490-a094-27ac541eeae3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:44.831372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f69d1-538e-4719-9a3c-2dedc687459f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:44.867177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce9fa7-d902-4f0b-bc3f-2b28407a982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:44.868014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce9fa7-d902-4f0b-bc3f-2b28407a982a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.868305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce9fa7-d902-4f0b-bc3f-2b28407a982a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.868584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce9fa7-d902-4f0b-bc3f-2b28407a982a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.878714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce9fa7-d902-4f0b-bc3f-2b28407a982a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e1ce9fa7-d902-4f0b-bc3f-2b28407a982a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:44.887283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:44.888313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:44.889126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 227/449] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:44.889774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db3e6a-af4b-4490-a094-27ac541eeae3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:44.894183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce9fa7-d902-4f0b-bc3f-2b28407a982a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:44.909021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:44.923435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3897-a5b9-45f6-ae32-2585f1da60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:44.924122 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3897-a5b9-45f6-ae32-2585f1da60f0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:44.924411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3897-a5b9-45f6-ae32-2585f1da60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:44.924696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3897-a5b9-45f6-ae32-2585f1da60f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:44.925534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3897-a5b9-45f6-ae32-2585f1da60f0 None admin] RBAC: Adding query filter params (group.id=630c7e3d248740239a5f563d64d25a50, role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=2a63d9b074144aa49bea1d60271c535e) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:44.925850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3897-a5b9-45f6-ae32-2585f1da60f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:44.927822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3897-a5b9-45f6-ae32-2585f1da60f0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:44.933748 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 223/450] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:44 2022] GET /identity/v3/role_assignments?group.id=630c7e3d248740239a5f563d64d25a50&scope.project.id=2a63d9b074144aa49bea1d60271c535e&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:45.000361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce9fa7-d902-4f0b-bc3f-2b28407a982a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:45.036479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86bb7-6b7c-494c-a5ba-ccb7f83c57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:45.037164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86bb7-6b7c-494c-a5ba-ccb7f83c57d2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:45.037451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86bb7-6b7c-494c-a5ba-ccb7f83c57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:45.037731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86bb7-6b7c-494c-a5ba-ccb7f83c57d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:45.038501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86bb7-6b7c-494c-a5ba-ccb7f83c57d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:45.038816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86bb7-6b7c-494c-a5ba-ccb7f83c57d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:45.040274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86bb7-6b7c-494c-a5ba-ccb7f83c57d2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:45.049496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 228/451] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:45.056638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3897-a5b9-45f6-ae32-2585f1da60f0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:45.093064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:45.160105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3897-a5b9-45f6-ae32-2585f1da60f0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:45.194668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf728cfb-7ebe-4bfd-bf98-ccc81c4580a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:45.195324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf728cfb-7ebe-4bfd-bf98-ccc81c4580a3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:45.195613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf728cfb-7ebe-4bfd-bf98-ccc81c4580a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:45.195915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf728cfb-7ebe-4bfd-bf98-ccc81c4580a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:45.265830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf728cfb-7ebe-4bfd-bf98-ccc81c4580a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:45.267218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf728cfb-7ebe-4bfd-bf98-ccc81c4580a3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:45.299821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:45.362276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 224/452] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:45.368126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86bb7-6b7c-494c-a5ba-ccb7f83c57d2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:45.438812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:45.463985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86bb7-6b7c-494c-a5ba-ccb7f83c57d2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:45.495326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927e06-5c97-4d74-a63c-bf7eaa1e3c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:45.496197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927e06-5c97-4d74-a63c-bf7eaa1e3c9d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:45.496480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927e06-5c97-4d74-a63c-bf7eaa1e3c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:45.496756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927e06-5c97-4d74-a63c-bf7eaa1e3c9d None admin] PATH_INFO: `/v3/projects/fccb2b976d33488897e5b5707f7da2b4` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:45.497917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69927e06-5c97-4d74-a63c-bf7eaa1e3c9d None admin] RBAC: Authorizing `identity:get_project(project_id=fccb2b976d33488897e5b5707f7da2b4)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:45.499355 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69927e06-5c97-4d74-a63c-bf7eaa1e3c9d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:45.501043 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 229/453] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:58:45 2022] GET /identity/v3/projects/fccb2b976d33488897e5b5707f7da2b4 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:45.507119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf728cfb-7ebe-4bfd-bf98-ccc81c4580a3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:45.608342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf728cfb-7ebe-4bfd-bf98-ccc81c4580a3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:45.648101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adb632-5322-4fe2-b6fa-571ad44e2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:45.648954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb632-5322-4fe2-b6fa-571ad44e2344 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:45.649235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb632-5322-4fe2-b6fa-571ad44e2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:45.649504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb632-5322-4fe2-b6fa-571ad44e2344 None admin] PATH_INFO: `/v3/groups/559a47542d364208bdd5044f8a61908e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:45.650674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adb632-5322-4fe2-b6fa-571ad44e2344 None admin] RBAC: Authorizing `identity:get_group(group_id=559a47542d364208bdd5044f8a61908e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:45.652210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adb632-5322-4fe2-b6fa-571ad44e2344 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:45.653882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 225/454] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 21:58:45 2022] GET /identity/v3/groups/559a47542d364208bdd5044f8a61908e => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:45.659651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927e06-5c97-4d74-a63c-bf7eaa1e3c9d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:45.761076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927e06-5c97-4d74-a63c-bf7eaa1e3c9d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:45.792457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba7adb-e8be-4a7d-bad3-f237bdf1f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:45.793094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba7adb-e8be-4a7d-bad3-f237bdf1f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:45.793377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba7adb-e8be-4a7d-bad3-f237bdf1f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:45.793650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba7adb-e8be-4a7d-bad3-f237bdf1f5e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:45.794469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba7adb-e8be-4a7d-bad3-f237bdf1f5e3 None admin] RBAC: Adding query filter params (group.id=559a47542d364208bdd5044f8a61908e, role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=fccb2b976d33488897e5b5707f7da2b4) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:45.794778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba7adb-e8be-4a7d-bad3-f237bdf1f5e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:45.796230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba7adb-e8be-4a7d-bad3-f237bdf1f5e3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:45.802312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 230/455] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 21:58:45 2022] GET /identity/v3/role_assignments?group.id=559a47542d364208bdd5044f8a61908e&scope.project.id=fccb2b976d33488897e5b5707f7da2b4&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:48.178940 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bef5-021f-4090-90b1-30de3124c842 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.179470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bef5-021f-4090-90b1-30de3124c842 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.179546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bef5-021f-4090-90b1-30de3124c842 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.181280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 226/456] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:48.186729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c5e3-bf90-45c3-9e6e-b0b8dd0fceb8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.187145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c5e3-bf90-45c3-9e6e-b0b8dd0fceb8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.187291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c5e3-bf90-45c3-9e6e-b0b8dd0fceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.200419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:48.209422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5ff4c5e3-bf90-45c3-9e6e-b0b8dd0fceb8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:48.211542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5ff4c5e3-bf90-45c3-9e6e-b0b8dd0fceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:48.302416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 231/457] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:48.351788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bef5-021f-4090-90b1-30de3124c842 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:48.356631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:48.481589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bef5-021f-4090-90b1-30de3124c842 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:48.527389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0fccd-1f5f-4efe-84d4-de0ee15c9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:48.528222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fccd-1f5f-4efe-84d4-de0ee15c9c67 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.528514 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fccd-1f5f-4efe-84d4-de0ee15c9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.528792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fccd-1f5f-4efe-84d4-de0ee15c9c67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.539693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0fccd-1f5f-4efe-84d4-de0ee15c9c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:48.545324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0fccd-1f5f-4efe-84d4-de0ee15c9c67 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-18e0fccd-1f5f-4efe-84d4-de0ee15c9c67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:48.563517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:48.564446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:48.565880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:48.565880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:48.565880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:48.565880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:48.565880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 227/458] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:48.571121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c5e3-bf90-45c3-9e6e-b0b8dd0fceb8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:48.587814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4db143-f640-423b-8366-f07f0b28eeea None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.588126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4db143-f640-423b-8366-f07f0b28eeea None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.588410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4db143-f640-423b-8366-f07f0b28eeea None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.589796 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 228/459] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:58:48.603674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05597-2d7b-4ab8-b7b1-15b2b7796722 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.603989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05597-2d7b-4ab8-b7b1-15b2b7796722 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.604278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05597-2d7b-4ab8-b7b1-15b2b7796722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.632186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-69a05597-2d7b-4ab8-b7b1-15b2b7796722 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:48.633392 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-69a05597-2d7b-4ab8-b7b1-15b2b7796722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:48.681585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c5e3-bf90-45c3-9e6e-b0b8dd0fceb8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:48.711673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:48.723173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c935bef-7ce7-4726-a6e2-9a68d34fd20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:48.723941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c935bef-7ce7-4726-a6e2-9a68d34fd20e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.724224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c935bef-7ce7-4726-a6e2-9a68d34fd20e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.724524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c935bef-7ce7-4726-a6e2-9a68d34fd20e None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.727928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c935bef-7ce7-4726-a6e2-9a68d34fd20e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:48.727928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c935bef-7ce7-4726-a6e2-9a68d34fd20e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:48.727928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c935bef-7ce7-4726-a6e2-9a68d34fd20e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:48.733764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:48.745400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 229/460] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:48.760966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 232/461] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:48.766186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05597-2d7b-4ab8-b7b1-15b2b7796722 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:48.777032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c935bef-7ce7-4726-a6e2-9a68d34fd20e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:48.901816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c935bef-7ce7-4726-a6e2-9a68d34fd20e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:48.936467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1073a6-7455-42c7-86b3-3b19bdd857a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:48.937262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1073a6-7455-42c7-86b3-3b19bdd857a0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.937553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1073a6-7455-42c7-86b3-3b19bdd857a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.937897 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1073a6-7455-42c7-86b3-3b19bdd857a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.943076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05597-2d7b-4ab8-b7b1-15b2b7796722 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:48.951304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1073a6-7455-42c7-86b3-3b19bdd857a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:48.952794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1073a6-7455-42c7-86b3-3b19bdd857a0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9d1073a6-7455-42c7-86b3-3b19bdd857a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:48.971833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:48.973234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:48.974775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:48.974775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:48.974775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:48.974775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:48.974775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 233/462] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:48.978096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad8164-4486-467b-b0aa-bb2a7928d0c8 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.978777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad8164-4486-467b-b0aa-bb2a7928d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.979124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad8164-4486-467b-b0aa-bb2a7928d0c8 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.980502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 234/463] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:48.981733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435de08-379c-4add-9675-08c2de21ac6a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.982020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435de08-379c-4add-9675-08c2de21ac6a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.982296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435de08-379c-4add-9675-08c2de21ac6a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.987514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 235/464] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:48.987514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435de08-379c-4add-9675-08c2de21ac6a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:48.988499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8e9f8-df94-4d91-93cb-7face8b4fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:48.989388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e9f8-df94-4d91-93cb-7face8b4fd35 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:48.989853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e9f8-df94-4d91-93cb-7face8b4fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:48.990399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e9f8-df94-4d91-93cb-7face8b4fd35 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:48.991295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8e9f8-df94-4d91-93cb-7face8b4fd35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:48.992965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8e9f8-df94-4d91-93cb-7face8b4fd35 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:49.015496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 230/465] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:48 2022] POST /identity/v3/users => generated 246 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:49.016832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03429785-5206-46cf-b623-8ff0da55d786 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.017115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03429785-5206-46cf-b623-8ff0da55d786 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.017400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03429785-5206-46cf-b623-8ff0da55d786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.037902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-03429785-5206-46cf-b623-8ff0da55d786 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:49.039198 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-03429785-5206-46cf-b623-8ff0da55d786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:49.054729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:49.086303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:49.132792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435de08-379c-4add-9675-08c2de21ac6a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:49.137831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 231/466] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:49.139469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b5bb-eb25-41b1-ae3a-988b2bab2080 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.140047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b5bb-eb25-41b1-ae3a-988b2bab2080 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.140569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b5bb-eb25-41b1-ae3a-988b2bab2080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.157688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-eba6b5bb-eb25-41b1-ae3a-988b2bab2080 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:49.159212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-eba6b5bb-eb25-41b1-ae3a-988b2bab2080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:49.174902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472863ff-2976-4418-8bc4-c61a34aa0163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:49.175589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472863ff-2976-4418-8bc4-c61a34aa0163 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.175990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472863ff-2976-4418-8bc4-c61a34aa0163 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.176270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472863ff-2976-4418-8bc4-c61a34aa0163 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.177805 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472863ff-2976-4418-8bc4-c61a34aa0163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:49.178115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472863ff-2976-4418-8bc4-c61a34aa0163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:49.179945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472863ff-2976-4418-8bc4-c61a34aa0163 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:49.197540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 236/467] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:49.198607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472863ff-2976-4418-8bc4-c61a34aa0163 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:49.244766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 232/468] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:49.246301 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b5bb-eb25-41b1-ae3a-988b2bab2080 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:49.333943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472863ff-2976-4418-8bc4-c61a34aa0163 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:49.343920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:49.370053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b5bb-eb25-41b1-ae3a-988b2bab2080 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:49.372103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:49.378137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2119dd-ec6e-4ec8-a1c8-71e8556f8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:49.378997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2119dd-ec6e-4ec8-a1c8-71e8556f8e8c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.379285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2119dd-ec6e-4ec8-a1c8-71e8556f8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.379571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2119dd-ec6e-4ec8-a1c8-71e8556f8e8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.391120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2119dd-ec6e-4ec8-a1c8-71e8556f8e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:49.392686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2119dd-ec6e-4ec8-a1c8-71e8556f8e8c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-3b2119dd-ec6e-4ec8-a1c8-71e8556f8e8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:49.411274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:49.412209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:49.413056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:49.413056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:49.413056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:49.413056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:49.413056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 237/469] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:49.413322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2119dd-ec6e-4ec8-a1c8-71e8556f8e8c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:49.422373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3b338-9181-4883-a573-a4565420c871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:49.423917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3b338-9181-4883-a573-a4565420c871 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.424457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3b338-9181-4883-a573-a4565420c871 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.424944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3b338-9181-4883-a573-a4565420c871 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.426813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3b338-9181-4883-a573-a4565420c871 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:49.429220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3b338-9181-4883-a573-a4565420c871 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:49.459482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 233/470] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:49 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:49.464310 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3b338-9181-4883-a573-a4565420c871 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:49.594699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2119dd-ec6e-4ec8-a1c8-71e8556f8e8c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:49.638504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a57d-12fd-4381-b910-2b57eceb68b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:49.639318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a57d-12fd-4381-b910-2b57eceb68b1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.639660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a57d-12fd-4381-b910-2b57eceb68b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.639969 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a57d-12fd-4381-b910-2b57eceb68b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.653891 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a57d-12fd-4381-b910-2b57eceb68b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:49.655612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a57d-12fd-4381-b910-2b57eceb68b1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:49.677945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3b338-9181-4883-a573-a4565420c871 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ab92a57d-12fd-4381-b910-2b57eceb68b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:49.683390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:49.684270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:49.685104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:49.685104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:49.685104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:49.685104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:49.685104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 238/471] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:49.690902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a57d-12fd-4381-b910-2b57eceb68b1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:49.713148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:49.732497 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8886-9810-4db3-9ce5-a643dc8d400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:49.734064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8886-9810-4db3-9ce5-a643dc8d400e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.734553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8886-9810-4db3-9ce5-a643dc8d400e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.735029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8886-9810-4db3-9ce5-a643dc8d400e None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.736171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf8886-9810-4db3-9ce5-a643dc8d400e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:49.737493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf8886-9810-4db3-9ce5-a643dc8d400e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:49.739152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf8886-9810-4db3-9ce5-a643dc8d400e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:49.756881 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 234/472] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:49.762342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8886-9810-4db3-9ce5-a643dc8d400e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:49.811839 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:49.819961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a57d-12fd-4381-b910-2b57eceb68b1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:49.876020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659c32e-a7de-4645-a412-b852f39abfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:49.877271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659c32e-a7de-4645-a412-b852f39abfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.878157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659c32e-a7de-4645-a412-b852f39abfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.878657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659c32e-a7de-4645-a412-b852f39abfb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.880244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659c32e-a7de-4645-a412-b852f39abfb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:49.880776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659c32e-a7de-4645-a412-b852f39abfb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:49.883208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659c32e-a7de-4645-a412-b852f39abfb5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:49.894120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8886-9810-4db3-9ce5-a643dc8d400e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:49.901471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 239/473] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:49.903071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a1c2-8b99-4d92-ad2e-d4b6493796ab None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.903573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a1c2-8b99-4d92-ad2e-d4b6493796ab None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.904085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a1c2-8b99-4d92-ad2e-d4b6493796ab None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.905767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 240/474] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:49.907471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5a1c2-8b99-4d92-ad2e-d4b6493796ab None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:49.943380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859edb73-a27d-4c43-bfa2-890237511dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:49.944117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859edb73-a27d-4c43-bfa2-890237511dea None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.944474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859edb73-a27d-4c43-bfa2-890237511dea None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.944756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859edb73-a27d-4c43-bfa2-890237511dea None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.945493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859edb73-a27d-4c43-bfa2-890237511dea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:49.946942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859edb73-a27d-4c43-bfa2-890237511dea None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:49.974062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 235/475] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:49 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:49.975536 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff743a77-5283-42a5-b31d-05c1106d37d2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:49.975886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff743a77-5283-42a5-b31d-05c1106d37d2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:49.976446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff743a77-5283-42a5-b31d-05c1106d37d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:49.995265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ff743a77-5283-42a5-b31d-05c1106d37d2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:49.996609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ff743a77-5283-42a5-b31d-05c1106d37d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:50.018119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:50.095160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5a1c2-8b99-4d92-ad2e-d4b6493796ab None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:50.112350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 236/476] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:50.147708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff743a77-5283-42a5-b31d-05c1106d37d2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:50.151202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591fa01-389b-4339-ba52-782953bf7cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:50.151921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591fa01-389b-4339-ba52-782953bf7cd6 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:50.152220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591fa01-389b-4339-ba52-782953bf7cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:50.152600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591fa01-389b-4339-ba52-782953bf7cd6 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:50.153331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591fa01-389b-4339-ba52-782953bf7cd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:50.154865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591fa01-389b-4339-ba52-782953bf7cd6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:50.157215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:50.182858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 241/477] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:49 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 21:58:50.294287 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff743a77-5283-42a5-b31d-05c1106d37d2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:50.335093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:50.336193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:50.336703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:50.337213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:50.338180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:50.339753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:50.349614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.sql.core [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 21:58:50.349614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 13 21:58:50.349614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [parameters: {'id': 'db3a0552b6dc40b4a81d9be663fa5f76', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 13 21:58:50.349614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80410) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application conn.query(q) Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result.read() Jul 13 21:58:50.367515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return ref.to_dict() Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 21:58:50.368506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application next(self.gen) Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application yield resource Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application next(self.gen) Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise self.value Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application session.commit() Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 21:58:50.369410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.session.flush() Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application compat.raise_( Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 21:58:50.370253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 21:58:50.371120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application conn.query(q) Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result.read() Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 21:58:50.371959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [parameters: {'id': 'db3a0552b6dc40b4a81d9be663fa5f76', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:50.372730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 13 21:58:50.373516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:50.377412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 237/478] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 21:58:50 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:50.384404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591fa01-389b-4339-ba52-782953bf7cd6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:50.506644 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591fa01-389b-4339-ba52-782953bf7cd6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:50.537581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:50.546690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15468ff-f69b-4431-beb8-0f2e50d5fa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:50.547565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15468ff-f69b-4431-beb8-0f2e50d5fa4c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:50.547856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15468ff-f69b-4431-beb8-0f2e50d5fa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:50.548164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15468ff-f69b-4431-beb8-0f2e50d5fa4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:50.565011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15468ff-f69b-4431-beb8-0f2e50d5fa4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-d15468ff-f69b-4431-beb8-0f2e50d5fa4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:50.573854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:50.575955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:50.577948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 242/479] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:58:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:50.585055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:50.681171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:50.724446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eff7ae-998a-452c-9d11-8211a3b2936c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:50.779047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727c986-0fbf-471c-95f7-955c6e30f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:50.780085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c986-0fbf-471c-95f7-955c6e30f8fe None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:50.780576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c986-0fbf-471c-95f7-955c6e30f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:50.781073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c986-0fbf-471c-95f7-955c6e30f8fe None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:50.782032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727c986-0fbf-471c-95f7-955c6e30f8fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:50.782538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727c986-0fbf-471c-95f7-955c6e30f8fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:50.784126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727c986-0fbf-471c-95f7-955c6e30f8fe None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:50.795330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 238/480] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:51.576132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69bff5-4c3d-42d5-8953-6c1d1650ca3f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:51.577159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69bff5-4c3d-42d5-8953-6c1d1650ca3f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:51.577648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69bff5-4c3d-42d5-8953-6c1d1650ca3f None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:51.579466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 243/481] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:51.585869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81de2e-bd8e-4c8c-b67b-69064b940da7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:51.586813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81de2e-bd8e-4c8c-b67b-69064b940da7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:51.587322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81de2e-bd8e-4c8c-b67b-69064b940da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:51.609032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ca81de2e-bd8e-4c8c-b67b-69064b940da7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:51.610255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ca81de2e-bd8e-4c8c-b67b-69064b940da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:51.703584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 239/482] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:51.740464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69bff5-4c3d-42d5-8953-6c1d1650ca3f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:51.861674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69bff5-4c3d-42d5-8953-6c1d1650ca3f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:51.905759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df9c2-014b-45a2-a34e-e2bf357327ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:51.906561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df9c2-014b-45a2-a34e-e2bf357327ef None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:51.906849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df9c2-014b-45a2-a34e-e2bf357327ef None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:51.907131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df9c2-014b-45a2-a34e-e2bf357327ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:51.920895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708df9c2-014b-45a2-a34e-e2bf357327ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-708df9c2-014b-45a2-a34e-e2bf357327ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:51.929892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:51.930777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:51.931563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 244/483] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:58:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:51.938743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81de2e-bd8e-4c8c-b67b-69064b940da7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:52.014907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5002c-55af-42ea-ae53-f7a55a74444e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.015223 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5002c-55af-42ea-ae53-f7a55a74444e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.015465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5002c-55af-42ea-ae53-f7a55a74444e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.020975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 245/484] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:52.022770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178f95f-1806-4ffe-b608-82f1d3790517 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.023054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178f95f-1806-4ffe-b608-82f1d3790517 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.023333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178f95f-1806-4ffe-b608-82f1d3790517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.049676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3178f95f-1806-4ffe-b608-82f1d3790517 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:52.051412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3178f95f-1806-4ffe-b608-82f1d3790517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:52.074568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:52.157145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:52.170373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81de2e-bd8e-4c8c-b67b-69064b940da7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:52.212220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60caea-773b-4884-b8e2-eb2fb0412e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:52.212919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60caea-773b-4884-b8e2-eb2fb0412e9a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.213170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60caea-773b-4884-b8e2-eb2fb0412e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.213445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60caea-773b-4884-b8e2-eb2fb0412e9a None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.214286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60caea-773b-4884-b8e2-eb2fb0412e9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:52.214599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60caea-773b-4884-b8e2-eb2fb0412e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:52.216071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60caea-773b-4884-b8e2-eb2fb0412e9a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:52.216496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 246/485] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:58:52.233064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 240/486] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:58:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:52.238602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178f95f-1806-4ffe-b608-82f1d3790517 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:52.250133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60caea-773b-4884-b8e2-eb2fb0412e9a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:52.362844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60caea-773b-4884-b8e2-eb2fb0412e9a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:52.387627 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:52.401316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3db82d-0d04-43a3-9287-b259a080f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:52.402114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3db82d-0d04-43a3-9287-b259a080f436 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.402396 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3db82d-0d04-43a3-9287-b259a080f436 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.402671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3db82d-0d04-43a3-9287-b259a080f436 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.413668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3db82d-0d04-43a3-9287-b259a080f436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2a3db82d-0d04-43a3-9287-b259a080f436 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:52.421515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:52.422394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:52.423185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:52.428096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 241/487] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:58:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:52.429906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3db82d-0d04-43a3-9287-b259a080f436 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:52.476177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178f95f-1806-4ffe-b608-82f1d3790517 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:52.538986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3db82d-0d04-43a3-9287-b259a080f436 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:52.553025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66833d-c5e1-4d03-a985-622d8aa367b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:52.554208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66833d-c5e1-4d03-a985-622d8aa367b4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.554723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66833d-c5e1-4d03-a985-622d8aa367b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.555195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66833d-c5e1-4d03-a985-622d8aa367b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.569042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66833d-c5e1-4d03-a985-622d8aa367b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:52.571404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66833d-c5e1-4d03-a985-622d8aa367b4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1d66833d-c5e1-4d03-a985-622d8aa367b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:52.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:52.604216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:52.605052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:52.605052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:52.605052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:52.605052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:52.618119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 247/488] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:52.625351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66833d-c5e1-4d03-a985-622d8aa367b4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:52.631245 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc44a01-927f-406b-b11c-58db0a0f56d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:52.632540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc44a01-927f-406b-b11c-58db0a0f56d9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.633966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc44a01-927f-406b-b11c-58db0a0f56d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.634450 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc44a01-927f-406b-b11c-58db0a0f56d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.635512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc44a01-927f-406b-b11c-58db0a0f56d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:52.640419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc44a01-927f-406b-b11c-58db0a0f56d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:52.642088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc44a01-927f-406b-b11c-58db0a0f56d9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:52.662540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 242/489] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:58:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:52.667827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc44a01-927f-406b-b11c-58db0a0f56d9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:52.677306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:52.756992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:52.786622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66833d-c5e1-4d03-a985-622d8aa367b4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:52.813424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc44a01-927f-406b-b11c-58db0a0f56d9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:52.823298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad8de-87c5-4d82-ac19-c3a4c16172d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:52.823997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad8de-87c5-4d82-ac19-c3a4c16172d4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.824292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad8de-87c5-4d82-ac19-c3a4c16172d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.824577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad8de-87c5-4d82-ac19-c3a4c16172d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.825322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad8de-87c5-4d82-ac19-c3a4c16172d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:52.825633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad8de-87c5-4d82-ac19-c3a4c16172d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:52.827220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad8de-87c5-4d82-ac19-c3a4c16172d4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:52.840323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 248/490] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:52.841454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c95685-826c-42ff-a806-18e7b669bda0 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.841746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c95685-826c-42ff-a806-18e7b669bda0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.842026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c95685-826c-42ff-a806-18e7b669bda0 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.843370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 249/491] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:52.844347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82b75-3abd-4f57-a16c-4aa3642cbb1d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.844629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82b75-3abd-4f57-a16c-4aa3642cbb1d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.844917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82b75-3abd-4f57-a16c-4aa3642cbb1d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.846245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 250/492] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:52.849623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82b75-3abd-4f57-a16c-4aa3642cbb1d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:52.856254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f01396-43e5-44ee-bcbb-a005667a7d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:52.857055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f01396-43e5-44ee-bcbb-a005667a7d1e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.857344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f01396-43e5-44ee-bcbb-a005667a7d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.857626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f01396-43e5-44ee-bcbb-a005667a7d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.871957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f01396-43e5-44ee-bcbb-a005667a7d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:52.873393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f01396-43e5-44ee-bcbb-a005667a7d1e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b6f01396-43e5-44ee-bcbb-a005667a7d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:52.895453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:52.896494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:52.902077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:52.902077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:52.902077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:52.902077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:52.902077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 243/493] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:52.902077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765da7e-e56e-4738-b04b-b39139e58fc0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:52.902077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765da7e-e56e-4738-b04b-b39139e58fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:52.902077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765da7e-e56e-4738-b04b-b39139e58fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:52.920024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a765da7e-e56e-4738-b04b-b39139e58fc0 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:52.921151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a765da7e-e56e-4738-b04b-b39139e58fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:52.948308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:52.961354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82b75-3abd-4f57-a16c-4aa3642cbb1d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.002950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 244/494] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:53.002950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e55bd-4907-42a8-973b-6664061ea07e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.002950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e55bd-4907-42a8-973b-6664061ea07e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.002950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e55bd-4907-42a8-973b-6664061ea07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.004442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77881c8e-be6c-4620-8a34-3037eb7efbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.005296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77881c8e-be6c-4620-8a34-3037eb7efbba None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.005585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77881c8e-be6c-4620-8a34-3037eb7efbba None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.005863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77881c8e-be6c-4620-8a34-3037eb7efbba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.013816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77881c8e-be6c-4620-8a34-3037eb7efbba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:53.015342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77881c8e-be6c-4620-8a34-3037eb7efbba None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:53.018993 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6e9e55bd-4907-42a8-973b-6664061ea07e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:53.020440 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6e9e55bd-4907-42a8-973b-6664061ea07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-77881c8e-be6c-4620-8a34-3037eb7efbba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:58:53.032633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:53.033535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:53.034416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 251/495] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 21:58:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:53.036174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77881c8e-be6c-4620-8a34-3037eb7efbba None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.045874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:53.103092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 245/496] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:53.103092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e55bd-4907-42a8-973b-6664061ea07e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.150278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77881c8e-be6c-4620-8a34-3037eb7efbba None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.184591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be196-dd3e-4325-987a-eada324a5ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.185183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be196-dd3e-4325-987a-eada324a5ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.185469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be196-dd3e-4325-987a-eada324a5ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.185751 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be196-dd3e-4325-987a-eada324a5ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.186480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be196-dd3e-4325-987a-eada324a5ea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:53.186787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be196-dd3e-4325-987a-eada324a5ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:53.188196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be196-dd3e-4325-987a-eada324a5ea2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:53.204688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 252/497] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:53.204688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be196-dd3e-4325-987a-eada324a5ea2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.218050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:53.225587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e55bd-4907-42a8-973b-6664061ea07e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.265154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6dd8-029a-4eb7-95a3-f205a99d305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.265950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6dd8-029a-4eb7-95a3-f205a99d305b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.266230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6dd8-029a-4eb7-95a3-f205a99d305b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.266499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6dd8-029a-4eb7-95a3-f205a99d305b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.277409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae6dd8-029a-4eb7-95a3-f205a99d305b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4fae6dd8-029a-4eb7-95a3-f205a99d305b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:53.285637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:53.286545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 246/498] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:53.292095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6dd8-029a-4eb7-95a3-f205a99d305b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.309836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:53.321859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be196-dd3e-4325-987a-eada324a5ea2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.359590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15710195-3a57-4df8-9530-8099068d1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.360387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15710195-3a57-4df8-9530-8099068d1aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.360676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15710195-3a57-4df8-9530-8099068d1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.360959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15710195-3a57-4df8-9530-8099068d1aa7 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.362192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15710195-3a57-4df8-9530-8099068d1aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:53.362192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15710195-3a57-4df8-9530-8099068d1aa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:53.364201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15710195-3a57-4df8-9530-8099068d1aa7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:53.397512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6dd8-029a-4eb7-95a3-f205a99d305b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.405307 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 253/499] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:53.405307 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15710195-3a57-4df8-9530-8099068d1aa7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.433639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a92ae9-84ab-43b5-a0e3-ce776d100009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.434556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a92ae9-84ab-43b5-a0e3-ce776d100009 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.434962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a92ae9-84ab-43b5-a0e3-ce776d100009 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.435257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a92ae9-84ab-43b5-a0e3-ce776d100009 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.447118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a92ae9-84ab-43b5-a0e3-ce776d100009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-00a92ae9-84ab-43b5-a0e3-ce776d100009 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:53.454937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:53.456003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:53.457178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:53.458587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 247/500] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:53.459429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a92ae9-84ab-43b5-a0e3-ce776d100009 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.482943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:53.516741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15710195-3a57-4df8-9530-8099068d1aa7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.541219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:53.553765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b042e-573d-4552-a5c1-880f324d0419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.554695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b042e-573d-4552-a5c1-880f324d0419 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.555084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b042e-573d-4552-a5c1-880f324d0419 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.555456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b042e-573d-4552-a5c1-880f324d0419 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.563207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b042e-573d-4552-a5c1-880f324d0419 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:53.564742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b042e-573d-4552-a5c1-880f324d0419 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:53.569646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a92ae9-84ab-43b5-a0e3-ce776d100009 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c17b042e-573d-4552-a5c1-880f324d0419 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:58:53.580401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:53.581505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 254/501] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:53.587178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b042e-573d-4552-a5c1-880f324d0419 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.611116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49228c20-d23e-45e5-9f80-ed49579b6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.611784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49228c20-d23e-45e5-9f80-ed49579b6507 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.612093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49228c20-d23e-45e5-9f80-ed49579b6507 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.612374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49228c20-d23e-45e5-9f80-ed49579b6507 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.613777 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49228c20-d23e-45e5-9f80-ed49579b6507 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:53.614134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49228c20-d23e-45e5-9f80-ed49579b6507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:53.615500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49228c20-d23e-45e5-9f80-ed49579b6507 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:53.623413 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 248/502] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:53.624386 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49228c20-d23e-45e5-9f80-ed49579b6507 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.688454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b042e-573d-4552-a5c1-880f324d0419 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.713397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:53.721921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013cc5a-9981-489f-80fe-e85886ca40a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.723172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013cc5a-9981-489f-80fe-e85886ca40a6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.723459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013cc5a-9981-489f-80fe-e85886ca40a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.723745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013cc5a-9981-489f-80fe-e85886ca40a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.725377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49228c20-d23e-45e5-9f80-ed49579b6507 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.759663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc914b-b52f-470a-817e-0db0568f6b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.760357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc914b-b52f-470a-817e-0db0568f6b3a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.760642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc914b-b52f-470a-817e-0db0568f6b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.760918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc914b-b52f-470a-817e-0db0568f6b3a None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.761656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc914b-b52f-470a-817e-0db0568f6b3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:53.761962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc914b-b52f-470a-817e-0db0568f6b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:53.763320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc914b-b52f-470a-817e-0db0568f6b3a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:53.768252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:53.775317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 249/503] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:53.776368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc914b-b52f-470a-817e-0db0568f6b3a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.791154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013cc5a-9981-489f-80fe-e85886ca40a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:53.792651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013cc5a-9981-489f-80fe-e85886ca40a6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:53.872738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc914b-b52f-470a-817e-0db0568f6b3a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:53.891005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 255/504] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:53.892344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9cb6-20f9-45db-ba27-2adebc3e3150 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.892638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9cb6-20f9-45db-ba27-2adebc3e3150 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.892922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9cb6-20f9-45db-ba27-2adebc3e3150 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.895938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 256/505] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:53.895938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e9cb6-20f9-45db-ba27-2adebc3e3150 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:53.909632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf282a0-cbe8-46e3-b990-c9b4a05fa44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:53.910418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf282a0-cbe8-46e3-b990-c9b4a05fa44f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:53.910673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf282a0-cbe8-46e3-b990-c9b4a05fa44f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:53.910952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf282a0-cbe8-46e3-b990-c9b4a05fa44f None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:53.911788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf282a0-cbe8-46e3-b990-c9b4a05fa44f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:53.912135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf282a0-cbe8-46e3-b990-c9b4a05fa44f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:53.913544 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf282a0-cbe8-46e3-b990-c9b4a05fa44f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:53.923643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:53.950270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 250/506] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:53.951027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf282a0-cbe8-46e3-b990-c9b4a05fa44f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.002244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e9cb6-20f9-45db-ba27-2adebc3e3150 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.007338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:54.036333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fe01-0f9c-44e7-8ea2-19517b3a337f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.037120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fe01-0f9c-44e7-8ea2-19517b3a337f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.037406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fe01-0f9c-44e7-8ea2-19517b3a337f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.037680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fe01-0f9c-44e7-8ea2-19517b3a337f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.047344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699fe01-0f9c-44e7-8ea2-19517b3a337f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.048760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf282a0-cbe8-46e3-b990-c9b4a05fa44f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.048877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699fe01-0f9c-44e7-8ea2-19517b3a337f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-d699fe01-0f9c-44e7-8ea2-19517b3a337f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:54.066782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:54.067812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:54.068731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:54.068731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:54.068731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.068731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:54.068731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 257/507] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:54.068731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fe01-0f9c-44e7-8ea2-19517b3a337f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.084615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240858a-c2f8-4050-ab77-65b5e5da9e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.085412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240858a-c2f8-4050-ab77-65b5e5da9e25 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.085698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240858a-c2f8-4050-ab77-65b5e5da9e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.085969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240858a-c2f8-4050-ab77-65b5e5da9e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.097371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240858a-c2f8-4050-ab77-65b5e5da9e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.098987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240858a-c2f8-4050-ab77-65b5e5da9e25 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-d240858a-c2f8-4050-ab77-65b5e5da9e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:54.116572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:54.117484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:54.118316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:54.118316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:54.118316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.118316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:54.118316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 251/508] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:54.118970 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25130342-a6ca-49d2-9f8f-d68ff41aa0eb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.119255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25130342-a6ca-49d2-9f8f-d68ff41aa0eb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.119534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25130342-a6ca-49d2-9f8f-d68ff41aa0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.136070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-25130342-a6ca-49d2-9f8f-d68ff41aa0eb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:54.137264 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-25130342-a6ca-49d2-9f8f-d68ff41aa0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:54.154019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:54.173908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fe01-0f9c-44e7-8ea2-19517b3a337f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.202455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 252/509] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:54.203212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25130342-a6ca-49d2-9f8f-d68ff41aa0eb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.207391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a53cb-9159-46dc-b308-43bf017f3274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.208554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a53cb-9159-46dc-b308-43bf017f3274 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.208845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a53cb-9159-46dc-b308-43bf017f3274 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.209127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a53cb-9159-46dc-b308-43bf017f3274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.219222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a53cb-9159-46dc-b308-43bf017f3274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.220714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a53cb-9159-46dc-b308-43bf017f3274 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b44a53cb-9159-46dc-b308-43bf017f3274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:54.238833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:54.239713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:54.240729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:54.240729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:54.240729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.240729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:54.240729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 258/510] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:54.241100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a53cb-9159-46dc-b308-43bf017f3274 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.248513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:54.306358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25130342-a6ca-49d2-9f8f-d68ff41aa0eb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.339218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b83f73-3502-4fac-bdb2-9606772f89d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.339465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a53cb-9159-46dc-b308-43bf017f3274 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.339865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83f73-3502-4fac-bdb2-9606772f89d1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.340181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83f73-3502-4fac-bdb2-9606772f89d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.340462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83f73-3502-4fac-bdb2-9606772f89d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.367596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:54.373275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c8394-51b2-4245-868c-81dfcacd1930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.373934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8394-51b2-4245-868c-81dfcacd1930 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.374880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8394-51b2-4245-868c-81dfcacd1930 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.374880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8394-51b2-4245-868c-81dfcacd1930 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.375216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c8394-51b2-4245-868c-81dfcacd1930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:54.375527 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c8394-51b2-4245-868c-81dfcacd1930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.376933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c8394-51b2-4245-868c-81dfcacd1930 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.389065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 259/511] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:54.389856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c8394-51b2-4245-868c-81dfcacd1930 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.413044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b83f73-3502-4fac-bdb2-9606772f89d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.414499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b83f73-3502-4fac-bdb2-9606772f89d1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.455590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:54.487335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c8394-51b2-4245-868c-81dfcacd1930 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.513411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 253/512] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:54.514481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b83f73-3502-4fac-bdb2-9606772f89d1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.521623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33696c-5388-4cf3-ae41-047bece6fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.522285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33696c-5388-4cf3-ae41-047bece6fb0c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.522579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33696c-5388-4cf3-ae41-047bece6fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.522864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33696c-5388-4cf3-ae41-047bece6fb0c None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.523597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33696c-5388-4cf3-ae41-047bece6fb0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:54.523923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33696c-5388-4cf3-ae41-047bece6fb0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.525322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33696c-5388-4cf3-ae41-047bece6fb0c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.537834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 260/513] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:54.538945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33696c-5388-4cf3-ae41-047bece6fb0c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.592138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:54.613501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b83f73-3502-4fac-bdb2-9606772f89d1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.639368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33696c-5388-4cf3-ae41-047bece6fb0c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.646640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480af44-b374-41df-bc52-6027eddf558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.647425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480af44-b374-41df-bc52-6027eddf558e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.647711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480af44-b374-41df-bc52-6027eddf558e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.648022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480af44-b374-41df-bc52-6027eddf558e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.655968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:54.658060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480af44-b374-41df-bc52-6027eddf558e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.659513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480af44-b374-41df-bc52-6027eddf558e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.673472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b7b6-c37a-4b90-a866-a751d1e590fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.674127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b7b6-c37a-4b90-a866-a751d1e590fb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.674412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b7b6-c37a-4b90-a866-a751d1e590fb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.674690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b7b6-c37a-4b90-a866-a751d1e590fb None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.675443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2b7b6-c37a-4b90-a866-a751d1e590fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:54.675751 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2b7b6-c37a-4b90-a866-a751d1e590fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.677148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2b7b6-c37a-4b90-a866-a751d1e590fb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-5480af44-b374-41df-bc52-6027eddf558e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:54.677807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:54.678749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:54.679717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:54.679717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:54.679717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.679717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:54.679717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 254/514] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:54.680071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480af44-b374-41df-bc52-6027eddf558e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.695470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 261/515] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:54.695470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b7b6-c37a-4b90-a866-a751d1e590fb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.778325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480af44-b374-41df-bc52-6027eddf558e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.795824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b7b6-c37a-4b90-a866-a751d1e590fb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.808225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:54.813370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cff3a-47fe-4bc8-99ac-124eed4f88bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.814188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cff3a-47fe-4bc8-99ac-124eed4f88bd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.814470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cff3a-47fe-4bc8-99ac-124eed4f88bd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.814742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cff3a-47fe-4bc8-99ac-124eed4f88bd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.821820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cff3a-47fe-4bc8-99ac-124eed4f88bd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.823244 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cff3a-47fe-4bc8-99ac-124eed4f88bd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.828777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed1ea-4f97-4e3e-8067-287d1d411a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.829560 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed1ea-4f97-4e3e-8067-287d1d411a4b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.829850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed1ea-4f97-4e3e-8067-287d1d411a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.830127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed1ea-4f97-4e3e-8067-287d1d411a4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-275cff3a-47fe-4bc8-99ac-124eed4f88bd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:58:54.839571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:54.840658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:54.841545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 255/516] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:54.842098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ed1ea-4f97-4e3e-8067-287d1d411a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.842167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cff3a-47fe-4bc8-99ac-124eed4f88bd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.842815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ed1ea-4f97-4e3e-8067-287d1d411a4b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-dd4ed1ea-4f97-4e3e-8067-287d1d411a4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:54.861407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:54.862449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:54.864092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:54.864092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:54.864092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:54.864092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:54.864092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 262/517] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:54.864092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed1ea-4f97-4e3e-8067-287d1d411a4b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:54.896461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:54.944515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cff3a-47fe-4bc8-99ac-124eed4f88bd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.963730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed1ea-4f97-4e3e-8067-287d1d411a4b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:54.979366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ca0b9-805f-45ed-9b48-8780e2371994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.980193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ca0b9-805f-45ed-9b48-8780e2371994 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.980501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ca0b9-805f-45ed-9b48-8780e2371994 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.980781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ca0b9-805f-45ed-9b48-8780e2371994 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.987646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ca0b9-805f-45ed-9b48-8780e2371994 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:54.989768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ca0b9-805f-45ed-9b48-8780e2371994 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:54.997362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b94d6-b029-4158-85d1-21b24b7dd407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:54.998015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b94d6-b029-4158-85d1-21b24b7dd407 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:54.998302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b94d6-b029-4158-85d1-21b24b7dd407 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:54.998583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b94d6-b029-4158-85d1-21b24b7dd407 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:54.999307 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b94d6-b029-4158-85d1-21b24b7dd407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:54.999614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b94d6-b029-4158-85d1-21b24b7dd407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.000998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b94d6-b029-4158-85d1-21b24b7dd407 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-257ca0b9-805f-45ed-9b48-8780e2371994 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:58:55.004030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:55.005067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:55.006092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 256/518] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:55.006714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ca0b9-805f-45ed-9b48-8780e2371994 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.013005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 263/519] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:55.013656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b94d6-b029-4158-85d1-21b24b7dd407 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.037984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:55.107604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ca0b9-805f-45ed-9b48-8780e2371994 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.111191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b94d6-b029-4158-85d1-21b24b7dd407 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.121621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:55.143601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868856da-6acc-4b9e-a6fe-3629010be134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.144478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868856da-6acc-4b9e-a6fe-3629010be134 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.144770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868856da-6acc-4b9e-a6fe-3629010be134 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.145049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868856da-6acc-4b9e-a6fe-3629010be134 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.146128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb6042-da79-49c9-a80f-3de4078c04d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.146794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb6042-da79-49c9-a80f-3de4078c04d3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.147076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb6042-da79-49c9-a80f-3de4078c04d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.147353 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb6042-da79-49c9-a80f-3de4078c04d3 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.148234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb6042-da79-49c9-a80f-3de4078c04d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:55.148544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb6042-da79-49c9-a80f-3de4078c04d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.149967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb6042-da79-49c9-a80f-3de4078c04d3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.151590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868856da-6acc-4b9e-a6fe-3629010be134 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.153044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868856da-6acc-4b9e-a6fe-3629010be134 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.166965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 264/520] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:55.167750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb6042-da79-49c9-a80f-3de4078c04d3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-868856da-6acc-4b9e-a6fe-3629010be134 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:58:55.167945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:55.168791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:55.169641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:58:55.169641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:58:55.169641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:58:55.169641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:58:55.169641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:58:55.169641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:58:55.169641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:58:55.169641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:55.169641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 257/521] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:55.170124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868856da-6acc-4b9e-a6fe-3629010be134 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.252991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:55.270989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868856da-6acc-4b9e-a6fe-3629010be134 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.272453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb6042-da79-49c9-a80f-3de4078c04d3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.305337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ba79-fcb3-45c2-b2d0-886e3b8df064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.305942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ba79-fcb3-45c2-b2d0-886e3b8df064 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.306170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6dd69-e6f6-4862-a56f-9d2c8a0d3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.306290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ba79-fcb3-45c2-b2d0-886e3b8df064 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.306496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ba79-fcb3-45c2-b2d0-886e3b8df064 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.306823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6dd69-e6f6-4862-a56f-9d2c8a0d3859 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.307105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6dd69-e6f6-4862-a56f-9d2c8a0d3859 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.307335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32ba79-fcb3-45c2-b2d0-886e3b8df064 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:55.307432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6dd69-e6f6-4862-a56f-9d2c8a0d3859 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.307646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32ba79-fcb3-45c2-b2d0-886e3b8df064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.308121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6dd69-e6f6-4862-a56f-9d2c8a0d3859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:55.308429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6dd69-e6f6-4862-a56f-9d2c8a0d3859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.309131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32ba79-fcb3-45c2-b2d0-886e3b8df064 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.309772 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6dd69-e6f6-4862-a56f-9d2c8a0d3859 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.320785 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 265/522] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:55.321552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6dd69-e6f6-4862-a56f-9d2c8a0d3859 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.327183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 258/523] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:55.328015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ba79-fcb3-45c2-b2d0-886e3b8df064 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.360222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:55.422258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6dd69-e6f6-4862-a56f-9d2c8a0d3859 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.427126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ba79-fcb3-45c2-b2d0-886e3b8df064 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.455018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2bddd-a4ae-487c-bd46-90901d64544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.455680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2bddd-a4ae-487c-bd46-90901d64544a None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.455995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2bddd-a4ae-487c-bd46-90901d64544a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.456274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2bddd-a4ae-487c-bd46-90901d64544a None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.458038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2bddd-a4ae-487c-bd46-90901d64544a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.459502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2bddd-a4ae-487c-bd46-90901d64544a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.461152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79a4aa-5d80-4732-b3fd-5b391665e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.461794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a4aa-5d80-4732-b3fd-5b391665e482 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.462076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a4aa-5d80-4732-b3fd-5b391665e482 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.462354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a4aa-5d80-4732-b3fd-5b391665e482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.474961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:55.481331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 266/524] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:58:55 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:58:55.482442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2bddd-a4ae-487c-bd46-90901d64544a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.546585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79a4aa-5d80-4732-b3fd-5b391665e482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.548407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79a4aa-5d80-4732-b3fd-5b391665e482 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.584441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:55.597770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2bddd-a4ae-487c-bd46-90901d64544a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.636229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40a395-5f8e-4706-a0e5-2f524576692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.636907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40a395-5f8e-4706-a0e5-2f524576692d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.637195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40a395-5f8e-4706-a0e5-2f524576692d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.637478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40a395-5f8e-4706-a0e5-2f524576692d None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.638282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40a395-5f8e-4706-a0e5-2f524576692d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:55.638593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40a395-5f8e-4706-a0e5-2f524576692d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.640064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40a395-5f8e-4706-a0e5-2f524576692d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.661581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 267/525] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:55.662466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40a395-5f8e-4706-a0e5-2f524576692d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.680108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 259/526] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:55.681483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79a4aa-5d80-4732-b3fd-5b391665e482 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.726925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:55.773901 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40a395-5f8e-4706-a0e5-2f524576692d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.794211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79a4aa-5d80-4732-b3fd-5b391665e482 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.810171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fab65-f9e3-4307-8687-5864463a7225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.811335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fab65-f9e3-4307-8687-5864463a7225 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.811606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fab65-f9e3-4307-8687-5864463a7225 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.811878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fab65-f9e3-4307-8687-5864463a7225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.819334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fab65-f9e3-4307-8687-5864463a7225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.820812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fab65-f9e3-4307-8687-5864463a7225 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.825828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:55.833407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfe992-3514-4f8a-9ad1-8aca1d9b46fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.834062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfe992-3514-4f8a-9ad1-8aca1d9b46fb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.834350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfe992-3514-4f8a-9ad1-8aca1d9b46fb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.834676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfe992-3514-4f8a-9ad1-8aca1d9b46fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b48fab65-f9e3-4307-8687-5864463a7225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:58:55.835922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:55.836715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 268/527] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:55.842440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fab65-f9e3-4307-8687-5864463a7225 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:55.915152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfe992-3514-4f8a-9ad1-8aca1d9b46fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.916992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfe992-3514-4f8a-9ad1-8aca1d9b46fb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.948884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fab65-f9e3-4307-8687-5864463a7225 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:55.967402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:55.987176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d311-0011-41b7-bab1-210d21203d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:55.987890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d311-0011-41b7-bab1-210d21203d49 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:55.988205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d311-0011-41b7-bab1-210d21203d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:55.988487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d311-0011-41b7-bab1-210d21203d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:55.989450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8d311-0011-41b7-bab1-210d21203d49 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=44e6d786ac4a40468794b18cfedfa730) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:55.989769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8d311-0011-41b7-bab1-210d21203d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:55.991349 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8d311-0011-41b7-bab1-210d21203d49 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:55.997598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 269/528] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/role_assignments?user.id=44e6d786ac4a40468794b18cfedfa730&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:55.998453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d311-0011-41b7-bab1-210d21203d49 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.033218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 260/529] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:58:56.034348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfe992-3514-4f8a-9ad1-8aca1d9b46fb None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.071121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:56.145636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d311-0011-41b7-bab1-210d21203d49 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:56.163823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfe992-3514-4f8a-9ad1-8aca1d9b46fb None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:56.190143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1831d-3b07-4d9d-aa20-f7dda834a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:56.191635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1831d-3b07-4d9d-aa20-f7dda834a897 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:56.191992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1831d-3b07-4d9d-aa20-f7dda834a897 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:56.192227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1831d-3b07-4d9d-aa20-f7dda834a897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:56.200486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0169e7-5922-477d-af75-c7ef77e2e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:56.201385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0169e7-5922-477d-af75-c7ef77e2e1ed None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:56.201835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0169e7-5922-477d-af75-c7ef77e2e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:56.202293 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0169e7-5922-477d-af75-c7ef77e2e1ed None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:56.203086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0169e7-5922-477d-af75-c7ef77e2e1ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:56.203400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0169e7-5922-477d-af75-c7ef77e2e1ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:56.204758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1831d-3b07-4d9d-aa20-f7dda834a897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:56.204887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0169e7-5922-477d-af75-c7ef77e2e1ed None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:56.205851 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1831d-3b07-4d9d-aa20-f7dda834a897 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:56.225530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 261/530] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:56.226533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0169e7-5922-477d-af75-c7ef77e2e1ed None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4da1831d-3b07-4d9d-aa20-f7dda834a897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:56.227085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:56.227921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:56.228779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:56.228779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:56.228779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:56.228779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:56.231997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 270/531] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:56.233721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1831d-3b07-4d9d-aa20-f7dda834a897 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.279260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:56.340609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:56.351114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0169e7-5922-477d-af75-c7ef77e2e1ed None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:56.370788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1831d-3b07-4d9d-aa20-f7dda834a897 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:56.389009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac75ee6-6974-490b-8941-528f16f22442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:56.389906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75ee6-6974-490b-8941-528f16f22442 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:56.390197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75ee6-6974-490b-8941-528f16f22442 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:56.390470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75ee6-6974-490b-8941-528f16f22442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:56.402426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac75ee6-6974-490b-8941-528f16f22442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:56.404003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac75ee6-6974-490b-8941-528f16f22442 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:56.409700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd902d-97de-4d7e-840d-c32bc54cc5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:56.410642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd902d-97de-4d7e-840d-c32bc54cc5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:56.411127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd902d-97de-4d7e-840d-c32bc54cc5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:56.411575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd902d-97de-4d7e-840d-c32bc54cc5b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:56.412712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd902d-97de-4d7e-840d-c32bc54cc5b4 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=b6d929086ac74f1bb5f323cca822fbbf) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:56.413193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd902d-97de-4d7e-840d-c32bc54cc5b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:56.414773 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd902d-97de-4d7e-840d-c32bc54cc5b4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:56.421232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 271/532] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/role_assignments?user.id=b6d929086ac74f1bb5f323cca822fbbf&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-dac75ee6-6974-490b-8941-528f16f22442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:56.421622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:56.422623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:56.423541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:56.423541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:56.423541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:56.423541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:56.423541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 262/533] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:56.424885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd902d-97de-4d7e-840d-c32bc54cc5b4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.429228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac75ee6-6974-490b-8941-528f16f22442 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.538496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:56.541321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd902d-97de-4d7e-840d-c32bc54cc5b4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:56.546312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac75ee6-6974-490b-8941-528f16f22442 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:56.580588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212b1ea-9b86-4d76-afb3-295b51746017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:56.581282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212b1ea-9b86-4d76-afb3-295b51746017 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:56.582199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212b1ea-9b86-4d76-afb3-295b51746017 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:56.582558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212b1ea-9b86-4d76-afb3-295b51746017 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:56.583714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212b1ea-9b86-4d76-afb3-295b51746017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:56.584098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212b1ea-9b86-4d76-afb3-295b51746017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:56.585625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212b1ea-9b86-4d76-afb3-295b51746017 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:56.589199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d18057-d940-4121-a9e7-af9cd8bd1657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:56.590137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d18057-d940-4121-a9e7-af9cd8bd1657 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:56.590614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d18057-d940-4121-a9e7-af9cd8bd1657 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:56.591101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d18057-d940-4121-a9e7-af9cd8bd1657 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:56.592093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d18057-d940-4121-a9e7-af9cd8bd1657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:56.592617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d18057-d940-4121-a9e7-af9cd8bd1657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:56.594282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d18057-d940-4121-a9e7-af9cd8bd1657 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:56.599007 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 272/534] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:56.604863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212b1ea-9b86-4d76-afb3-295b51746017 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.608923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 263/535] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:56.614263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d18057-d940-4121-a9e7-af9cd8bd1657 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.617594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:56.718046 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212b1ea-9b86-4d76-afb3-295b51746017 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:56.730503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d18057-d940-4121-a9e7-af9cd8bd1657 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:56.757748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ba27b-6d11-4656-a894-3b6cc791dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:56.758536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ba27b-6d11-4656-a894-3b6cc791dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:56.758816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ba27b-6d11-4656-a894-3b6cc791dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:56.759099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ba27b-6d11-4656-a894-3b6cc791dcf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:56.766865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ba27b-6d11-4656-a894-3b6cc791dcf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:56.768505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ba27b-6d11-4656-a894-3b6cc791dcf8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:56.772031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713943fd-0779-4ffb-a37e-b8de54399623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:56.773075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713943fd-0779-4ffb-a37e-b8de54399623 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:56.773556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713943fd-0779-4ffb-a37e-b8de54399623 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:56.774027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713943fd-0779-4ffb-a37e-b8de54399623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:56.781464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713943fd-0779-4ffb-a37e-b8de54399623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:56.783229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713943fd-0779-4ffb-a37e-b8de54399623 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-515ba27b-6d11-4656-a894-3b6cc791dcf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:58:56.783476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:56.784306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:56.785759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:58:56.785759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:58:56.785759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:58:56.785759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:58:56.785759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:58:56.785759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:58:56.785759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:58:56.785759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:56.786681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 273/536] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:56.792142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ba27b-6d11-4656-a894-3b6cc791dcf8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-713943fd-0779-4ffb-a37e-b8de54399623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:58:56.802622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:56.803890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:56.804759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:58:56.804759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:58:56.804759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:58:56.804759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:58:56.804759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:58:56.804759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:58:56.804759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:58:56.804759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:56.807379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 264/537] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:56.812986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713943fd-0779-4ffb-a37e-b8de54399623 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:56.813636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:56.904084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ba27b-6d11-4656-a894-3b6cc791dcf8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:56.935346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:56.941004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca889ba-3d33-4d6c-a0aa-5d227be43a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:56.941948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca889ba-3d33-4d6c-a0aa-5d227be43a71 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:56.942385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca889ba-3d33-4d6c-a0aa-5d227be43a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:56.943123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca889ba-3d33-4d6c-a0aa-5d227be43a71 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:56.944178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca889ba-3d33-4d6c-a0aa-5d227be43a71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:56.944696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca889ba-3d33-4d6c-a0aa-5d227be43a71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:56.946369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca889ba-3d33-4d6c-a0aa-5d227be43a71 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:56.961669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 274/538] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:56.967664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca889ba-3d33-4d6c-a0aa-5d227be43a71 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:57.014662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713943fd-0779-4ffb-a37e-b8de54399623 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:57.060640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:57.093063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf6c2-0ef2-4084-ac14-31c6a29ec9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:57.093731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf6c2-0ef2-4084-ac14-31c6a29ec9eb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:57.094019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf6c2-0ef2-4084-ac14-31c6a29ec9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:57.094296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf6c2-0ef2-4084-ac14-31c6a29ec9eb None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:57.095089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf6c2-0ef2-4084-ac14-31c6a29ec9eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:57.095396 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf6c2-0ef2-4084-ac14-31c6a29ec9eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:57.096854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf6c2-0ef2-4084-ac14-31c6a29ec9eb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:57.105176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca889ba-3d33-4d6c-a0aa-5d227be43a71 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:57.120687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 265/539] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:57.126371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf6c2-0ef2-4084-ac14-31c6a29ec9eb None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:57.177690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5d825-1df1-4e03-a165-40191c2fe9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:57.178346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5d825-1df1-4e03-a165-40191c2fe9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:57.178628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5d825-1df1-4e03-a165-40191c2fe9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:57.178901 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5d825-1df1-4e03-a165-40191c2fe9a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:57.179742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5d825-1df1-4e03-a165-40191c2fe9a6 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=fb227a145fdd44319f5ccbe762409ebc) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:57.180081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5d825-1df1-4e03-a165-40191c2fe9a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:57.183687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5d825-1df1-4e03-a165-40191c2fe9a6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:57.197037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 275/540] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:56 2022] GET /identity/v3/role_assignments?user.id=fb227a145fdd44319f5ccbe762409ebc&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:58:57.300176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf6c2-0ef2-4084-ac14-31c6a29ec9eb None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:57.338387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:57.356658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e78b3f-6289-4465-b7e3-8c3792179f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:57.357323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78b3f-6289-4465-b7e3-8c3792179f71 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:57.357605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78b3f-6289-4465-b7e3-8c3792179f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:57.357879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78b3f-6289-4465-b7e3-8c3792179f71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:57.358713 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e78b3f-6289-4465-b7e3-8c3792179f71 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=46a7d9cfbbcd4068aa9241ffd694c631) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:57.359021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e78b3f-6289-4465-b7e3-8c3792179f71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:57.360484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e78b3f-6289-4465-b7e3-8c3792179f71 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:57.367572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 266/541] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:58:57 2022] GET /identity/v3/role_assignments?user.id=46a7d9cfbbcd4068aa9241ffd694c631&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:57.907470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b517-69be-47ad-b74e-9f4965c10473 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:57.908009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b517-69be-47ad-b74e-9f4965c10473 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:57.908089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b517-69be-47ad-b74e-9f4965c10473 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:57.909817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 276/542] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:57.914885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93070c3b-5ca7-4da8-9c0c-6c2018888494 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:57.915322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93070c3b-5ca7-4da8-9c0c-6c2018888494 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:57.915468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93070c3b-5ca7-4da8-9c0c-6c2018888494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:57.939466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-93070c3b-5ca7-4da8-9c0c-6c2018888494 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:57.940732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-93070c3b-5ca7-4da8-9c0c-6c2018888494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:58.033533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 267/543] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:58.071853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b517-69be-47ad-b74e-9f4965c10473 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:58.241867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b517-69be-47ad-b74e-9f4965c10473 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:58.290535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd9e6-03a1-487f-a99e-84079f298ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:58.291342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd9e6-03a1-487f-a99e-84079f298ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:58.291626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd9e6-03a1-487f-a99e-84079f298ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:58.291918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd9e6-03a1-487f-a99e-84079f298ef6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:58.302996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdd9e6-03a1-487f-a99e-84079f298ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-53fdd9e6-03a1-487f-a99e-84079f298ef6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:58.310747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:58.311612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:58.312459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 277/544] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:58.318815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93070c3b-5ca7-4da8-9c0c-6c2018888494 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:58.475952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93070c3b-5ca7-4da8-9c0c-6c2018888494 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:58.501450 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:58.525529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb19715-4ca9-4614-8c46-1c8ec20d1c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:58.526213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb19715-4ca9-4614-8c46-1c8ec20d1c68 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:58.526496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb19715-4ca9-4614-8c46-1c8ec20d1c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:58.526774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb19715-4ca9-4614-8c46-1c8ec20d1c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:58.527530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb19715-4ca9-4614-8c46-1c8ec20d1c68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:58.527837 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb19715-4ca9-4614-8c46-1c8ec20d1c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:58.529304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb19715-4ca9-4614-8c46-1c8ec20d1c68 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:58.544757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd9e6-03a1-487f-a99e-84079f298ef6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:58.545834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 268/545] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:58:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:58.548628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:58.560643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65dbb-d0a6-4653-b4b6-4de44c96dc2c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:58.560953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65dbb-d0a6-4653-b4b6-4de44c96dc2c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:58.561208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65dbb-d0a6-4653-b4b6-4de44c96dc2c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:58.563383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 269/546] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:58:58.569322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a4f1-b6c3-4909-9d66-29adf06db3d6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:58.569614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a4f1-b6c3-4909-9d66-29adf06db3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:58.569891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a4f1-b6c3-4909-9d66-29adf06db3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:58.588294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-51b1a4f1-b6c3-4909-9d66-29adf06db3d6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:58.589500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-51b1a4f1-b6c3-4909-9d66-29adf06db3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:58.665878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 270/547] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:58.699920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a4f1-b6c3-4909-9d66-29adf06db3d6 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:58.770576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd9e6-03a1-487f-a99e-84079f298ef6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:58.826475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687f267-6f25-4981-a0c7-2fc6c7ebde05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:58.827267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f267-6f25-4981-a0c7-2fc6c7ebde05 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:58.827552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f267-6f25-4981-a0c7-2fc6c7ebde05 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:58.827826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f267-6f25-4981-a0c7-2fc6c7ebde05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:58.840240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687f267-6f25-4981-a0c7-2fc6c7ebde05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:58.841707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687f267-6f25-4981-a0c7-2fc6c7ebde05 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-3687f267-6f25-4981-a0c7-2fc6c7ebde05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:58.861861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:58.862839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:58.864276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:58.864276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:58.864276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:58.864276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:58.864276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 278/548] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:58.869212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687f267-6f25-4981-a0c7-2fc6c7ebde05 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:58.929317 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:58.952941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a4f1-b6c3-4909-9d66-29adf06db3d6 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:58.972712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:59.007483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687f267-6f25-4981-a0c7-2fc6c7ebde05 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:59.024548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5fd1e-0b2a-4de2-8f0c-ced388434ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.026442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5fd1e-0b2a-4de2-8f0c-ced388434ccb None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.026737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5fd1e-0b2a-4de2-8f0c-ced388434ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.027018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5fd1e-0b2a-4de2-8f0c-ced388434ccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.051814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5fd1e-0b2a-4de2-8f0c-ced388434ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9ce5fd1e-0b2a-4de2-8f0c-ced388434ccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:59.060764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:59.061633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:59.062920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:59.070578 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9595ea-22a1-4201-83e7-d5fbc344610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.071239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9595ea-22a1-4201-83e7-d5fbc344610a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.071526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9595ea-22a1-4201-83e7-d5fbc344610a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.071807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9595ea-22a1-4201-83e7-d5fbc344610a None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.072600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9595ea-22a1-4201-83e7-d5fbc344610a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:59.072914 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9595ea-22a1-4201-83e7-d5fbc344610a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:59.073595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 271/549] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:59.076766 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9595ea-22a1-4201-83e7-d5fbc344610a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:59.078941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5fd1e-0b2a-4de2-8f0c-ced388434ccb None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:59.100109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 279/550] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:59.117719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9595ea-22a1-4201-83e7-d5fbc344610a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:59.241603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5fd1e-0b2a-4de2-8f0c-ced388434ccb None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:59.264498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9595ea-22a1-4201-83e7-d5fbc344610a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:59.278786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cd44f-8253-4d39-ae43-f37ad6c3fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.279818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cd44f-8253-4d39-ae43-f37ad6c3fa1f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.280335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cd44f-8253-4d39-ae43-f37ad6c3fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.280833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cd44f-8253-4d39-ae43-f37ad6c3fa1f None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.281791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cd44f-8253-4d39-ae43-f37ad6c3fa1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:59.282132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:59.282520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cd44f-8253-4d39-ae43-f37ad6c3fa1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:59.284144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cd44f-8253-4d39-ae43-f37ad6c3fa1f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:59.294048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 272/551] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:58:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:59.295671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe3b7-c625-4889-97cc-960c0d9ef646 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.296240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe3b7-c625-4889-97cc-960c0d9ef646 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.296727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe3b7-c625-4889-97cc-960c0d9ef646 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.298762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 273/552] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:59.299686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe3b7-c625-4889-97cc-960c0d9ef646 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:59.311244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a304fc3-4873-4f29-8eee-9fb6308a5f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.312110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a304fc3-4873-4f29-8eee-9fb6308a5f3d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.312394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a304fc3-4873-4f29-8eee-9fb6308a5f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.312668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a304fc3-4873-4f29-8eee-9fb6308a5f3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.322300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a304fc3-4873-4f29-8eee-9fb6308a5f3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:59.323753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a304fc3-4873-4f29-8eee-9fb6308a5f3d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:59.334850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2a304fc3-4873-4f29-8eee-9fb6308a5f3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:58:59.342472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:59.343396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:58:59.344820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:58:59.347975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 280/553] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:58:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:58:59.349632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530752-520b-44c1-aee0-01cc588ae8e9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.349924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530752-520b-44c1-aee0-01cc588ae8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.350205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530752-520b-44c1-aee0-01cc588ae8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.374744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e7530752-520b-44c1-aee0-01cc588ae8e9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:59.376503 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e7530752-520b-44c1-aee0-01cc588ae8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:58:59.421100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe3b7-c625-4889-97cc-960c0d9ef646 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:59.460321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327fe54-49d4-4028-9bc1-596a53b7dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.461418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327fe54-49d4-4028-9bc1-596a53b7dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.461529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327fe54-49d4-4028-9bc1-596a53b7dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.461906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327fe54-49d4-4028-9bc1-596a53b7dcd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.472569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 281/554] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:58:59.472882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7530752-520b-44c1-aee0-01cc588ae8e9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:59.478915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327fe54-49d4-4028-9bc1-596a53b7dcd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:59.481236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327fe54-49d4-4028-9bc1-596a53b7dcd4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2327fe54-49d4-4028-9bc1-596a53b7dcd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:58:59.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:59.507039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:59.508009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:58:59.508009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:58:59.508009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:58:59.508009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:59.508009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 274/555] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:59.509254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327fe54-49d4-4028-9bc1-596a53b7dcd4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:59.599520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:59.604028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7530752-520b-44c1-aee0-01cc588ae8e9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:59.607712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:59.621062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327fe54-49d4-4028-9bc1-596a53b7dcd4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:59.641681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17394969-02ed-489d-af69-15f83c0e89dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.642664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17394969-02ed-489d-af69-15f83c0e89dc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.642964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17394969-02ed-489d-af69-15f83c0e89dc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.643252 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17394969-02ed-489d-af69-15f83c0e89dc None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.644180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17394969-02ed-489d-af69-15f83c0e89dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:59.644657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17394969-02ed-489d-af69-15f83c0e89dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:59.646141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17394969-02ed-489d-af69-15f83c0e89dc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:59.658219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb4b6-e4bc-40c4-a2b1-9cf9165121c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.659275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb4b6-e4bc-40c4-a2b1-9cf9165121c9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.660576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb4b6-e4bc-40c4-a2b1-9cf9165121c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.661143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb4b6-e4bc-40c4-a2b1-9cf9165121c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.665927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 282/556] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 21:58:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:59.667549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17394969-02ed-489d-af69-15f83c0e89dc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:59.675031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cb4b6-e4bc-40c4-a2b1-9cf9165121c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f65cb4b6-e4bc-40c4-a2b1-9cf9165121c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:58:59.683428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:58:59.684443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:58:59.685848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 275/557] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:58:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:58:59.686532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38def6d7-4682-450a-8964-fe9453e00c5f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.686532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38def6d7-4682-450a-8964-fe9453e00c5f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.686798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38def6d7-4682-450a-8964-fe9453e00c5f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.692145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 276/558] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:58:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:58:59.692145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38def6d7-4682-450a-8964-fe9453e00c5f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:59.778372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17394969-02ed-489d-af69-15f83c0e89dc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:59.801183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38def6d7-4682-450a-8964-fe9453e00c5f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:59.811943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853861-d922-457d-8d38-a11cba65b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.812603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853861-d922-457d-8d38-a11cba65b7ed None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.812891 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853861-d922-457d-8d38-a11cba65b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.813168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853861-d922-457d-8d38-a11cba65b7ed None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.813889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df853861-d922-457d-8d38-a11cba65b7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:59.814192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df853861-d922-457d-8d38-a11cba65b7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:59.815552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df853861-d922-457d-8d38-a11cba65b7ed None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:59.826597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 283/559] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:59.827378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853861-d922-457d-8d38-a11cba65b7ed None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:58:59.839201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b5b22-aee8-4cf7-ba43-17aa3151d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.839854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5b22-aee8-4cf7-ba43-17aa3151d088 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.840173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5b22-aee8-4cf7-ba43-17aa3151d088 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.840455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5b22-aee8-4cf7-ba43-17aa3151d088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.851544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:59.852610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:58:59.910017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b5b22-aee8-4cf7-ba43-17aa3151d088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:59.911226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b5b22-aee8-4cf7-ba43-17aa3151d088 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:59.926748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853861-d922-457d-8d38-a11cba65b7ed None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:58:59.960576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc674d4b-dc91-47fc-a4a7-6ffa40a49158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:58:59.961278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc674d4b-dc91-47fc-a4a7-6ffa40a49158 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.961509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc674d4b-dc91-47fc-a4a7-6ffa40a49158 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.961787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc674d4b-dc91-47fc-a4a7-6ffa40a49158 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.962549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc674d4b-dc91-47fc-a4a7-6ffa40a49158 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:58:59.962843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc674d4b-dc91-47fc-a4a7-6ffa40a49158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:58:59.964266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc674d4b-dc91-47fc-a4a7-6ffa40a49158 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:58:59.972563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 284/560] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:58:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:58:59.973633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81859d40-d1e0-474b-b4c5-da17283981a4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:58:59.973945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81859d40-d1e0-474b-b4c5-da17283981a4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:58:59.974224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81859d40-d1e0-474b-b4c5-da17283981a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:58:59.990198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-81859d40-d1e0-474b-b4c5-da17283981a4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:58:59.991382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-81859d40-d1e0-474b-b4c5-da17283981a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:00.014383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 277/561] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:59:00.015706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc1ee9-b5bc-413e-9535-c0d23b9ba4a9 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.016020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc1ee9-b5bc-413e-9535-c0d23b9ba4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.016317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc1ee9-b5bc-413e-9535-c0d23b9ba4a9 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.019934 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 278/562] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:00.019934 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc1ee9-b5bc-413e-9535-c0d23b9ba4a9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.060264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 285/563] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:00.061104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81859d40-d1e0-474b-b4c5-da17283981a4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.073855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.075179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.140017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc1ee9-b5bc-413e-9535-c0d23b9ba4a9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.162603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81859d40-d1e0-474b-b4c5-da17283981a4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.174603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb0736-396e-4e4a-82bd-5cdaac6b230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.175706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb0736-396e-4e4a-82bd-5cdaac6b230e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.175944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb0736-396e-4e4a-82bd-5cdaac6b230e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.176230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb0736-396e-4e4a-82bd-5cdaac6b230e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.183134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb0736-396e-4e4a-82bd-5cdaac6b230e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:00.184639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb0736-396e-4e4a-82bd-5cdaac6b230e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:00.197030 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164cd2-dd23-42f5-8dcc-70af61964d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.197817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164cd2-dd23-42f5-8dcc-70af61964d1f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.198098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164cd2-dd23-42f5-8dcc-70af61964d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.198371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164cd2-dd23-42f5-8dcc-70af61964d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-31bb0736-396e-4e4a-82bd-5cdaac6b230e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:00.199400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:00.200583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 279/564] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:00.201522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb0736-396e-4e4a-82bd-5cdaac6b230e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.213841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164cd2-dd23-42f5-8dcc-70af61964d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:00.215370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164cd2-dd23-42f5-8dcc-70af61964d1f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-7e164cd2-dd23-42f5-8dcc-70af61964d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:00.233740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:00.234664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:00.235589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:00.235589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:00.235589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:00.235589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:00.235589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 286/565] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:00.236185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a65a-54d2-4cb5-9cf4-51339640ed09 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.236451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a65a-54d2-4cb5-9cf4-51339640ed09 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.236696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a65a-54d2-4cb5-9cf4-51339640ed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.252623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c8d8a65a-54d2-4cb5-9cf4-51339640ed09 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:00.254334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c8d8a65a-54d2-4cb5-9cf4-51339640ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:00.304219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb0736-396e-4e4a-82bd-5cdaac6b230e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.305719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.310995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.319199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 287/566] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:00.320026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8a65a-54d2-4cb5-9cf4-51339640ed09 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.346230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c1a71-cdac-4acb-9c97-ef3173c8379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.347085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c1a71-cdac-4acb-9c97-ef3173c8379b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.347396 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c1a71-cdac-4acb-9c97-ef3173c8379b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.347785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c1a71-cdac-4acb-9c97-ef3173c8379b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.357757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c1a71-cdac-4acb-9c97-ef3173c8379b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:00.359257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c1a71-cdac-4acb-9c97-ef3173c8379b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-846c1a71-cdac-4acb-9c97-ef3173c8379b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:00.376844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:00.379165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:00.379165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:00.379165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:00.379165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:00.379165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 280/567] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:00.379437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c1a71-cdac-4acb-9c97-ef3173c8379b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.424356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8a65a-54d2-4cb5-9cf4-51339640ed09 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.457940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1f8a2-1110-4112-a824-27e8a5acd884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.458738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1f8a2-1110-4112-a824-27e8a5acd884 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.459022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1f8a2-1110-4112-a824-27e8a5acd884 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.459297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1f8a2-1110-4112-a824-27e8a5acd884 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.469783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1f8a2-1110-4112-a824-27e8a5acd884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-26c1f8a2-1110-4112-a824-27e8a5acd884 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:00.478047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:00.479137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:00.480393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:00.481100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c1a71-cdac-4acb-9c97-ef3173c8379b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.481184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 288/568] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:00.481184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1f8a2-1110-4112-a824-27e8a5acd884 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.518465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812c0a5-bc59-48dc-bf91-16c0754f9cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.519320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c0a5-bc59-48dc-bf91-16c0754f9cbf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.519555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c0a5-bc59-48dc-bf91-16c0754f9cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.519838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c0a5-bc59-48dc-bf91-16c0754f9cbf None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.520708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c0a5-bc59-48dc-bf91-16c0754f9cbf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:00.521014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c0a5-bc59-48dc-bf91-16c0754f9cbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:00.522424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c0a5-bc59-48dc-bf91-16c0754f9cbf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:00.534024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.539476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 281/569] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:00.540339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812c0a5-bc59-48dc-bf91-16c0754f9cbf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.555626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.586428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1f8a2-1110-4112-a824-27e8a5acd884 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.619664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3106597-d0db-4bbd-bbfc-a91b8e4a41ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.620284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3106597-d0db-4bbd-bbfc-a91b8e4a41ae None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.620570 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3106597-d0db-4bbd-bbfc-a91b8e4a41ae None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.620848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3106597-d0db-4bbd-bbfc-a91b8e4a41ae None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.621574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3106597-d0db-4bbd-bbfc-a91b8e4a41ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:00.621884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3106597-d0db-4bbd-bbfc-a91b8e4a41ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:00.623249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3106597-d0db-4bbd-bbfc-a91b8e4a41ae None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:00.634941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 289/570] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:00.634941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3106597-d0db-4bbd-bbfc-a91b8e4a41ae None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.646467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812c0a5-bc59-48dc-bf91-16c0754f9cbf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.681067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6161-87a8-4ccc-a6a3-1c29c57a76a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.681862 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6161-87a8-4ccc-a6a3-1c29c57a76a9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.682152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6161-87a8-4ccc-a6a3-1c29c57a76a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.682439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6161-87a8-4ccc-a6a3-1c29c57a76a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.692468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d6161-87a8-4ccc-a6a3-1c29c57a76a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f35d6161-87a8-4ccc-a6a3-1c29c57a76a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:00.700185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:00.701162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:00.701987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 282/571] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:00.702669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6161-87a8-4ccc-a6a3-1c29c57a76a9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.734826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3106597-d0db-4bbd-bbfc-a91b8e4a41ae None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.751162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.770371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e0a2-b8da-48ef-bf1f-125c3dc79dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.771029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e0a2-b8da-48ef-bf1f-125c3dc79dea None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.771311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e0a2-b8da-48ef-bf1f-125c3dc79dea None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.771591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e0a2-b8da-48ef-bf1f-125c3dc79dea None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.772342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069e0a2-b8da-48ef-bf1f-125c3dc79dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:00.772647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069e0a2-b8da-48ef-bf1f-125c3dc79dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:00.773847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.774020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069e0a2-b8da-48ef-bf1f-125c3dc79dea None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:00.785739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 290/572] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:00.786342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e0a2-b8da-48ef-bf1f-125c3dc79dea None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.808696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6161-87a8-4ccc-a6a3-1c29c57a76a9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.842090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d63bb7-a27d-401d-8f98-43186413c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.842754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d63bb7-a27d-401d-8f98-43186413c7cd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.843040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d63bb7-a27d-401d-8f98-43186413c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.843316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d63bb7-a27d-401d-8f98-43186413c7cd None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.844093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d63bb7-a27d-401d-8f98-43186413c7cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:00.844400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d63bb7-a27d-401d-8f98-43186413c7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:00.845755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d63bb7-a27d-401d-8f98-43186413c7cd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:00.854111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 283/573] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:00.854888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d63bb7-a27d-401d-8f98-43186413c7cd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.882152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e0a2-b8da-48ef-bf1f-125c3dc79dea None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.915460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33993524-6d62-4960-8668-47a29ccc67c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.916272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33993524-6d62-4960-8668-47a29ccc67c3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.916557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33993524-6d62-4960-8668-47a29ccc67c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.916832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33993524-6d62-4960-8668-47a29ccc67c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.929310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33993524-6d62-4960-8668-47a29ccc67c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:00.931849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33993524-6d62-4960-8668-47a29ccc67c3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-33993524-6d62-4960-8668-47a29ccc67c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:00.949583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:00.950682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:00.951585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:00.951585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:00.951585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:00.951585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:00.951585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 291/574] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:00.951585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33993524-6d62-4960-8668-47a29ccc67c3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:00.952300 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d63bb7-a27d-401d-8f98-43186413c7cd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:00.984048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.989106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207c70-3cca-4fa6-b58f-a16ace1bbcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:00.989895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207c70-3cca-4fa6-b58f-a16ace1bbcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:00.990175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207c70-3cca-4fa6-b58f-a16ace1bbcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:00.990449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207c70-3cca-4fa6-b58f-a16ace1bbcb6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:00.992386 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:00.999028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54207c70-3cca-4fa6-b58f-a16ace1bbcb6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.000489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54207c70-3cca-4fa6-b58f-a16ace1bbcb6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-54207c70-3cca-4fa6-b58f-a16ace1bbcb6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:01.014810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:01.016182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 284/575] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:01.017114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207c70-3cca-4fa6-b58f-a16ace1bbcb6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.059731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33993524-6d62-4960-8668-47a29ccc67c3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.092865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0467dc-8107-433c-8239-2fa636a27283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.093525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0467dc-8107-433c-8239-2fa636a27283 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.093807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0467dc-8107-433c-8239-2fa636a27283 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.094079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0467dc-8107-433c-8239-2fa636a27283 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.094817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0467dc-8107-433c-8239-2fa636a27283 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:01.095123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0467dc-8107-433c-8239-2fa636a27283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.096517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0467dc-8107-433c-8239-2fa636a27283 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.104891 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 292/576] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:01.105695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0467dc-8107-433c-8239-2fa636a27283 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.118849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207c70-3cca-4fa6-b58f-a16ace1bbcb6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.151723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636693a9-b6ee-4e48-a1b6-f8bef41d7b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.152480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636693a9-b6ee-4e48-a1b6-f8bef41d7b23 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.152764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636693a9-b6ee-4e48-a1b6-f8bef41d7b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.153042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636693a9-b6ee-4e48-a1b6-f8bef41d7b23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.160193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636693a9-b6ee-4e48-a1b6-f8bef41d7b23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.161627 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636693a9-b6ee-4e48-a1b6-f8bef41d7b23 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-636693a9-b6ee-4e48-a1b6-f8bef41d7b23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:01.175766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:01.176715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:01.177603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:01.177603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:01.177603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:01.177603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:01.177603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:01.177603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:01.177603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:01.177603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:01.177603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 285/577] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:01.178074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636693a9-b6ee-4e48-a1b6-f8bef41d7b23 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.204268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:01.215238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0467dc-8107-433c-8239-2fa636a27283 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.237234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:01.248771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aded2-6cd2-4cb1-855f-7c620484e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.249784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aded2-6cd2-4cb1-855f-7c620484e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.250120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aded2-6cd2-4cb1-855f-7c620484e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.250402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aded2-6cd2-4cb1-855f-7c620484e2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.262096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aded2-6cd2-4cb1-855f-7c620484e2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.263536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aded2-6cd2-4cb1-855f-7c620484e2d8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ad9aded2-6cd2-4cb1-855f-7c620484e2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:01.281250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:01.282117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:01.282995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:01.282995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:01.282995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:01.282995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:01.283434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636693a9-b6ee-4e48-a1b6-f8bef41d7b23 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.287370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 293/578] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:01.288178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aded2-6cd2-4cb1-855f-7c620484e2d8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.317974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb0db1-b9ac-4fdc-8b90-941c4e2daa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.318636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb0db1-b9ac-4fdc-8b90-941c4e2daa0c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.318922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb0db1-b9ac-4fdc-8b90-941c4e2daa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.319205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb0db1-b9ac-4fdc-8b90-941c4e2daa0c None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.319946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb0db1-b9ac-4fdc-8b90-941c4e2daa0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:01.320256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb0db1-b9ac-4fdc-8b90-941c4e2daa0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.321594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb0db1-b9ac-4fdc-8b90-941c4e2daa0c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.333410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 286/579] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:01.334192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb0db1-b9ac-4fdc-8b90-941c4e2daa0c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.392511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aded2-6cd2-4cb1-855f-7c620484e2d8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.426193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d449c6-ed70-432b-9e26-71f80b70f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.426792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d449c6-ed70-432b-9e26-71f80b70f356 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.427081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d449c6-ed70-432b-9e26-71f80b70f356 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.427365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d449c6-ed70-432b-9e26-71f80b70f356 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.428238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d449c6-ed70-432b-9e26-71f80b70f356 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:01.428555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d449c6-ed70-432b-9e26-71f80b70f356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.429986 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d449c6-ed70-432b-9e26-71f80b70f356 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.430144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb0db1-b9ac-4fdc-8b90-941c4e2daa0c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.443452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:01.444369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:01.448488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 294/580] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:01.449328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d449c6-ed70-432b-9e26-71f80b70f356 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.466922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbdf8c-bc2b-4739-9b4d-bfcef4d76859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.467718 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdf8c-bc2b-4739-9b4d-bfcef4d76859 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.468036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdf8c-bc2b-4739-9b4d-bfcef4d76859 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.468319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdf8c-bc2b-4739-9b4d-bfcef4d76859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.478894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbdf8c-bc2b-4739-9b4d-bfcef4d76859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.480371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbdf8c-bc2b-4739-9b4d-bfcef4d76859 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-2ffbdf8c-bc2b-4739-9b4d-bfcef4d76859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:01.497672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:01.498636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:01.499515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:01.499515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:01.499515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:01.499515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:01.499515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 287/581] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:01.499799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbdf8c-bc2b-4739-9b4d-bfcef4d76859 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.554765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d449c6-ed70-432b-9e26-71f80b70f356 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.588998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9d4d-1999-4f80-97d8-c1cb8059bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.589653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9d4d-1999-4f80-97d8-c1cb8059bba5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.589943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9d4d-1999-4f80-97d8-c1cb8059bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.590227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9d4d-1999-4f80-97d8-c1cb8059bba5 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.591015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9d4d-1999-4f80-97d8-c1cb8059bba5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:01.591350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9d4d-1999-4f80-97d8-c1cb8059bba5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.592826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9d4d-1999-4f80-97d8-c1cb8059bba5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.600953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbdf8c-bc2b-4739-9b4d-bfcef4d76859 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.604409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 295/582] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:01.605197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9d4d-1999-4f80-97d8-c1cb8059bba5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.634594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfb773-2899-467c-a819-9bece649887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.635261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfb773-2899-467c-a819-9bece649887d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.635550 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfb773-2899-467c-a819-9bece649887d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.635833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfb773-2899-467c-a819-9bece649887d None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.636590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfb773-2899-467c-a819-9bece649887d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:01.636903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfb773-2899-467c-a819-9bece649887d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.638272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfb773-2899-467c-a819-9bece649887d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.655314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 288/583] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:01.655314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfb773-2899-467c-a819-9bece649887d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.665053 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:01.679699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:01.710826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9d4d-1999-4f80-97d8-c1cb8059bba5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.744035 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acc006-30e8-4da1-b176-533f1423950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.744829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acc006-30e8-4da1-b176-533f1423950b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.745116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acc006-30e8-4da1-b176-533f1423950b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.745391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acc006-30e8-4da1-b176-533f1423950b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.752333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acc006-30e8-4da1-b176-533f1423950b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.753791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acc006-30e8-4da1-b176-533f1423950b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.754637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfb773-2899-467c-a819-9bece649887d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b0acc006-30e8-4da1-b176-533f1423950b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:01.767704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:01.768599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 296/584] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:01.774320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acc006-30e8-4da1-b176-533f1423950b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.788488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca816f5-bd2b-4093-95d2-59598d24b9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.789274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca816f5-bd2b-4093-95d2-59598d24b9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.789557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca816f5-bd2b-4093-95d2-59598d24b9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.789834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca816f5-bd2b-4093-95d2-59598d24b9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.799547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca816f5-bd2b-4093-95d2-59598d24b9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.801704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca816f5-bd2b-4093-95d2-59598d24b9e3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9ca816f5-bd2b-4093-95d2-59598d24b9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:01.818456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:01.819343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:01.820262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:01.820262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:01.820262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:01.820262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:01.820262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 289/585] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:01.820542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca816f5-bd2b-4093-95d2-59598d24b9e3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.875077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acc006-30e8-4da1-b176-533f1423950b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.895299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:01.901098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:01.911590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3916c-761b-47eb-aa7e-699a5655f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.912273 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3916c-761b-47eb-aa7e-699a5655f4ff None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.912559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3916c-761b-47eb-aa7e-699a5655f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.912837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3916c-761b-47eb-aa7e-699a5655f4ff None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.913557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3916c-761b-47eb-aa7e-699a5655f4ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:01.913866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3916c-761b-47eb-aa7e-699a5655f4ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.915225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3916c-761b-47eb-aa7e-699a5655f4ff None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.922678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca816f5-bd2b-4093-95d2-59598d24b9e3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:01.927012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 297/586] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:01.927796 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3916c-761b-47eb-aa7e-699a5655f4ff None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:01.957298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb816fd7-0337-4cb6-9f76-f0e4b3359ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:01.958149 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb816fd7-0337-4cb6-9f76-f0e4b3359ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:01.958431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb816fd7-0337-4cb6-9f76-f0e4b3359ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:01.958710 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb816fd7-0337-4cb6-9f76-f0e4b3359ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:01.959533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb816fd7-0337-4cb6-9f76-f0e4b3359ba6 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=2695a36b9b38450981588c31c2b9afc7) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:01.959847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb816fd7-0337-4cb6-9f76-f0e4b3359ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:01.961299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb816fd7-0337-4cb6-9f76-f0e4b3359ba6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:01.966571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 290/587] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/role_assignments?user.id=2695a36b9b38450981588c31c2b9afc7&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:01.967337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb816fd7-0337-4cb6-9f76-f0e4b3359ba6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.051119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3916c-761b-47eb-aa7e-699a5655f4ff None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.072583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb816fd7-0337-4cb6-9f76-f0e4b3359ba6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.091515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847afcf-b93b-47bd-af64-8b39f9315826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.092807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847afcf-b93b-47bd-af64-8b39f9315826 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.093301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847afcf-b93b-47bd-af64-8b39f9315826 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.093898 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847afcf-b93b-47bd-af64-8b39f9315826 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.103465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847afcf-b93b-47bd-af64-8b39f9315826 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.105573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847afcf-b93b-47bd-af64-8b39f9315826 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.110670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc56369-5b35-4fb8-8856-f15d701f6264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.111571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc56369-5b35-4fb8-8856-f15d701f6264 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.112066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc56369-5b35-4fb8-8856-f15d701f6264 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.112554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc56369-5b35-4fb8-8856-f15d701f6264 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.113560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc56369-5b35-4fb8-8856-f15d701f6264 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:02.114020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc56369-5b35-4fb8-8856-f15d701f6264 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.115670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc56369-5b35-4fb8-8856-f15d701f6264 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-d847afcf-b93b-47bd-af64-8b39f9315826 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:02.123916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:02.124860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:02.125865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 298/588] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:02.126449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847afcf-b93b-47bd-af64-8b39f9315826 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.131118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 291/589] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:02.131453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc56369-5b35-4fb8-8856-f15d701f6264 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.140448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:02.172504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:02.234258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847afcf-b93b-47bd-af64-8b39f9315826 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.235556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc56369-5b35-4fb8-8856-f15d701f6264 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.275141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33119-5fd2-4c51-bdae-9f4f5b8a88c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.275810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33119-5fd2-4c51-bdae-9f4f5b8a88c1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.276132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33119-5fd2-4c51-bdae-9f4f5b8a88c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.276417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33119-5fd2-4c51-bdae-9f4f5b8a88c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.277150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe33119-5fd2-4c51-bdae-9f4f5b8a88c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:02.277463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe33119-5fd2-4c51-bdae-9f4f5b8a88c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.277560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847c36-24d6-4008-90af-2bd655e47ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.278312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847c36-24d6-4008-90af-2bd655e47ced None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.278576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847c36-24d6-4008-90af-2bd655e47ced None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.278830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe33119-5fd2-4c51-bdae-9f4f5b8a88c1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.278925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847c36-24d6-4008-90af-2bd655e47ced None admin] PATH_INFO: `/v3/users/glance` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.286580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61847c36-24d6-4008-90af-2bd655e47ced None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.287647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61847c36-24d6-4008-90af-2bd655e47ced None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.296083 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 299/590] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:02.296083 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33119-5fd2-4c51-bdae-9f4f5b8a88c1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-61847c36-24d6-4008-90af-2bd655e47ced None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:02.304472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:02.305590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 292/591] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:02.306518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847c36-24d6-4008-90af-2bd655e47ced None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.370533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:02.401820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:02.405457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33119-5fd2-4c51-bdae-9f4f5b8a88c1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.416034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847c36-24d6-4008-90af-2bd655e47ced None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.444594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ff8ef-0293-4fa0-a6ac-aa2119dd50a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.445352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff8ef-0293-4fa0-a6ac-aa2119dd50a0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.445707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff8ef-0293-4fa0-a6ac-aa2119dd50a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.446056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff8ef-0293-4fa0-a6ac-aa2119dd50a0 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.446965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ff8ef-0293-4fa0-a6ac-aa2119dd50a0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:02.447350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ff8ef-0293-4fa0-a6ac-aa2119dd50a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.448865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ff8ef-0293-4fa0-a6ac-aa2119dd50a0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.453223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693fac1-fdf8-46a3-8c18-121fb71aec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.454189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693fac1-fdf8-46a3-8c18-121fb71aec22 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.454541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693fac1-fdf8-46a3-8c18-121fb71aec22 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.454889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693fac1-fdf8-46a3-8c18-121fb71aec22 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/44e6d786ac4a40468794b18cfedfa730/roles/c45ff064e30a4a689212d6aee4ed3dd7` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.470663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693fac1-fdf8-46a3-8c18-121fb71aec22 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=44e6d786ac4a40468794b18cfedfa730, role_id=c45ff064e30a4a689212d6aee4ed3dd7)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.472793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693fac1-fdf8-46a3-8c18-121fb71aec22 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.472906 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 300/592] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jul 13 21:59:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:02.473415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ff8ef-0293-4fa0-a6ac-aa2119dd50a0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.486789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 293/593] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:02 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/44e6d786ac4a40468794b18cfedfa730/roles/c45ff064e30a4a689212d6aee4ed3dd7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:59:02.487633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693fac1-fdf8-46a3-8c18-121fb71aec22 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.607179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693fac1-fdf8-46a3-8c18-121fb71aec22 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.620710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ff8ef-0293-4fa0-a6ac-aa2119dd50a0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.625080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:02.651727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6052d4e-63aa-46c8-94e2-575c641d5e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.652516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6052d4e-63aa-46c8-94e2-575c641d5e83 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.652809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6052d4e-63aa-46c8-94e2-575c641d5e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.653088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6052d4e-63aa-46c8-94e2-575c641d5e83 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.654562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6052d4e-63aa-46c8-94e2-575c641d5e83 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:02.654877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6052d4e-63aa-46c8-94e2-575c641d5e83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.656665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6052d4e-63aa-46c8-94e2-575c641d5e83 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.672920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9f8a6-33e1-4278-9ddc-24cb2bbb10f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.673733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9f8a6-33e1-4278-9ddc-24cb2bbb10f0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.674023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9f8a6-33e1-4278-9ddc-24cb2bbb10f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.674302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9f8a6-33e1-4278-9ddc-24cb2bbb10f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.681625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 294/594] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 21:59:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:02.682298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9f8a6-33e1-4278-9ddc-24cb2bbb10f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.682537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6052d4e-63aa-46c8-94e2-575c641d5e83 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.683834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9f8a6-33e1-4278-9ddc-24cb2bbb10f0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-06f9f8a6-33e1-4278-9ddc-24cb2bbb10f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:02.703398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:02.704344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:02.705216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:02.705216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:02.705216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:02.705216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:02.705216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:02.705216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:02.705216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:02.705216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:02.705216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 301/595] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:02.705692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9f8a6-33e1-4278-9ddc-24cb2bbb10f0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.733798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:02.805634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6052d4e-63aa-46c8-94e2-575c641d5e83 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.835743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9f8a6-33e1-4278-9ddc-24cb2bbb10f0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:02.841398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a870a4-6fa0-41ad-b551-cbade0fe539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.842382 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a870a4-6fa0-41ad-b551-cbade0fe539f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.842765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a870a4-6fa0-41ad-b551-cbade0fe539f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.843144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a870a4-6fa0-41ad-b551-cbade0fe539f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.853949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a870a4-6fa0-41ad-b551-cbade0fe539f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.855568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a870a4-6fa0-41ad-b551-cbade0fe539f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e1a870a4-6fa0-41ad-b551-cbade0fe539f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:02.874641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:02.875719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:02.876850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:02.876850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:02.876850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:02.876850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:02.878050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b408df8-d47b-4e5a-a3e4-881fb9f84611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:02.878920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 295/596] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:02.879200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b408df8-d47b-4e5a-a3e4-881fb9f84611 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:02.879640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b408df8-d47b-4e5a-a3e4-881fb9f84611 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:02.880028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a870a4-6fa0-41ad-b551-cbade0fe539f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.880240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b408df8-d47b-4e5a-a3e4-881fb9f84611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:02.894463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b408df8-d47b-4e5a-a3e4-881fb9f84611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:02.896698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b408df8-d47b-4e5a-a3e4-881fb9f84611 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:02.906717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4b408df8-d47b-4e5a-a3e4-881fb9f84611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:02.921956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:02.923114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:02.924192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:02.924192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:02.924192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:02.924192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:02.926286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 302/597] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:02.927236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b408df8-d47b-4e5a-a3e4-881fb9f84611 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:02.997388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a870a4-6fa0-41ad-b551-cbade0fe539f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:03.020493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:03.035242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694a116-af22-49ef-b1dd-d578b674018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:03.035923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694a116-af22-49ef-b1dd-d578b674018d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:03.036236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694a116-af22-49ef-b1dd-d578b674018d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:03.036517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694a116-af22-49ef-b1dd-d578b674018d None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:03.037309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694a116-af22-49ef-b1dd-d578b674018d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:03.037915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694a116-af22-49ef-b1dd-d578b674018d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:03.039044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694a116-af22-49ef-b1dd-d578b674018d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:03.052568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 296/598] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:03.053304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694a116-af22-49ef-b1dd-d578b674018d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:03.059615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b408df8-d47b-4e5a-a3e4-881fb9f84611 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:03.102186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c043c7-84e2-4a36-ae12-55b15cf66375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:03.102871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c043c7-84e2-4a36-ae12-55b15cf66375 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:03.103162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c043c7-84e2-4a36-ae12-55b15cf66375 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:03.103441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c043c7-84e2-4a36-ae12-55b15cf66375 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:03.106368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c043c7-84e2-4a36-ae12-55b15cf66375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:03.106368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c043c7-84e2-4a36-ae12-55b15cf66375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:03.106368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c043c7-84e2-4a36-ae12-55b15cf66375 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:03.125822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 303/599] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:03.129682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c043c7-84e2-4a36-ae12-55b15cf66375 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:03.162403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:03.182226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694a116-af22-49ef-b1dd-d578b674018d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:03.217736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6ba3d-b094-4c09-960d-bcddf539e639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:03.218398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6ba3d-b094-4c09-960d-bcddf539e639 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:03.218681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6ba3d-b094-4c09-960d-bcddf539e639 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:03.218958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6ba3d-b094-4c09-960d-bcddf539e639 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:03.219678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6ba3d-b094-4c09-960d-bcddf539e639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:03.220020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6ba3d-b094-4c09-960d-bcddf539e639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:03.221380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6ba3d-b094-4c09-960d-bcddf539e639 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:03.233140 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 297/600] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:03.233999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6ba3d-b094-4c09-960d-bcddf539e639 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:03.236161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c043c7-84e2-4a36-ae12-55b15cf66375 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:03.266732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:03.273996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b8a4f-00ae-43fc-baeb-7743d1a97a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:03.275221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b8a4f-00ae-43fc-baeb-7743d1a97a28 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:03.275711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b8a4f-00ae-43fc-baeb-7743d1a97a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:03.276311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b8a4f-00ae-43fc-baeb-7743d1a97a28 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/b6d929086ac74f1bb5f323cca822fbbf/roles/c45ff064e30a4a689212d6aee4ed3dd7` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:03.293123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b8a4f-00ae-43fc-baeb-7743d1a97a28 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=b6d929086ac74f1bb5f323cca822fbbf, role_id=c45ff064e30a4a689212d6aee4ed3dd7)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:03.294924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b8a4f-00ae-43fc-baeb-7743d1a97a28 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:03.313026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 304/601] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:03 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/b6d929086ac74f1bb5f323cca822fbbf/roles/c45ff064e30a4a689212d6aee4ed3dd7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:59:03.319386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b8a4f-00ae-43fc-baeb-7743d1a97a28 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:03.373064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6ba3d-b094-4c09-960d-bcddf539e639 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:03.444376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c49a57-3c75-4456-a470-965217933542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:03.445193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c49a57-3c75-4456-a470-965217933542 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:03.445481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c49a57-3c75-4456-a470-965217933542 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:03.445759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c49a57-3c75-4456-a470-965217933542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:03.460149 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c49a57-3c75-4456-a470-965217933542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:03.461623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c49a57-3c75-4456-a470-965217933542 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-81c49a57-3c75-4456-a470-965217933542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:03.492928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:03.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:03.494797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:03.494797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:03.494797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:03.494797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:03.494797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:03.494797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:03.494797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:03.494797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:03.494797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 298/602] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:03.501158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c49a57-3c75-4456-a470-965217933542 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:03.510044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:03.517050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b8a4f-00ae-43fc-baeb-7743d1a97a28 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:03.560420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f6fc6-f43d-474a-b589-d05c20f713b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:03.561701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f6fc6-f43d-474a-b589-d05c20f713b0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:03.562600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f6fc6-f43d-474a-b589-d05c20f713b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:03.563121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f6fc6-f43d-474a-b589-d05c20f713b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:03.573542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f6fc6-f43d-474a-b589-d05c20f713b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:03.575275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f6fc6-f43d-474a-b589-d05c20f713b0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ae5f6fc6-f43d-474a-b589-d05c20f713b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:03.598932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:03.600081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:03.601166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:03.601166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:03.601166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:03.601166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:03.601166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:03.601166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:03.601166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:03.601166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:03.603831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 305/603] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:03.609912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f6fc6-f43d-474a-b589-d05c20f713b0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:03.672086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:03.675894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c49a57-3c75-4456-a470-965217933542 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:03.720936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254570ea-d7ee-40f1-879f-ae9986b79ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:03.722493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254570ea-d7ee-40f1-879f-ae9986b79ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:03.724201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254570ea-d7ee-40f1-879f-ae9986b79ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:03.725749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254570ea-d7ee-40f1-879f-ae9986b79ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:03.726790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254570ea-d7ee-40f1-879f-ae9986b79ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:03.727508 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254570ea-d7ee-40f1-879f-ae9986b79ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:03.730504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254570ea-d7ee-40f1-879f-ae9986b79ba1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:03.756542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 299/604] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:03.764945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254570ea-d7ee-40f1-879f-ae9986b79ba1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:03.783542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f6fc6-f43d-474a-b589-d05c20f713b0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:03.820594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d8fe-99ef-4d7f-9083-89f47697d4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:03.821505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d8fe-99ef-4d7f-9083-89f47697d4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:03.822087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d8fe-99ef-4d7f-9083-89f47697d4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:03.822514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d8fe-99ef-4d7f-9083-89f47697d4b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:03.823659 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d8fe-99ef-4d7f-9083-89f47697d4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:03.824092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d8fe-99ef-4d7f-9083-89f47697d4b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:03.826177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d8fe-99ef-4d7f-9083-89f47697d4b4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:03.848403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 306/605] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:03.854438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d8fe-99ef-4d7f-9083-89f47697d4b4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:03.894540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:03.961670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254570ea-d7ee-40f1-879f-ae9986b79ba1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:04.016276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:04.018943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d8fe-99ef-4d7f-9083-89f47697d4b4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:04.029168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf45347-cf37-4f4d-989d-69d2a0c43d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:04.030189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf45347-cf37-4f4d-989d-69d2a0c43d2b None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:04.030572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf45347-cf37-4f4d-989d-69d2a0c43d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:04.030965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf45347-cf37-4f4d-989d-69d2a0c43d2b None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/fb227a145fdd44319f5ccbe762409ebc/roles/c45ff064e30a4a689212d6aee4ed3dd7` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:04.048611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf45347-cf37-4f4d-989d-69d2a0c43d2b None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=fb227a145fdd44319f5ccbe762409ebc, role_id=c45ff064e30a4a689212d6aee4ed3dd7)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:04.050467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf45347-cf37-4f4d-989d-69d2a0c43d2b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:04.080159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 300/606] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:03 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/fb227a145fdd44319f5ccbe762409ebc/roles/c45ff064e30a4a689212d6aee4ed3dd7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:59:04.087686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d66ce-4b51-4859-8a0a-7915d66abbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:04.088662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d66ce-4b51-4859-8a0a-7915d66abbd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:04.088950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d66ce-4b51-4859-8a0a-7915d66abbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:04.089226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d66ce-4b51-4859-8a0a-7915d66abbd7 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/46a7d9cfbbcd4068aa9241ffd694c631/roles/c45ff064e30a4a689212d6aee4ed3dd7` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:04.113783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d66ce-4b51-4859-8a0a-7915d66abbd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=46a7d9cfbbcd4068aa9241ffd694c631, role_id=c45ff064e30a4a689212d6aee4ed3dd7)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:04.115321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d66ce-4b51-4859-8a0a-7915d66abbd7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:04.138677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 307/607] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:03 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/46a7d9cfbbcd4068aa9241ffd694c631/roles/c45ff064e30a4a689212d6aee4ed3dd7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 21:59:04.227197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3317396-7615-400b-9edc-9c7ad5b30f5a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:04.227751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3317396-7615-400b-9edc-9c7ad5b30f5a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:04.227751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3317396-7615-400b-9edc-9c7ad5b30f5a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:04.229511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 301/608] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:04.235166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c7bd8-0cc6-46da-af81-0c233b93cd42 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:04.235478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c7bd8-0cc6-46da-af81-0c233b93cd42 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:04.235738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c7bd8-0cc6-46da-af81-0c233b93cd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:04.259673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ee2c7bd8-0cc6-46da-af81-0c233b93cd42 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:04.261034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ee2c7bd8-0cc6-46da-af81-0c233b93cd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:04.345865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 308/609] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:04.370174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3317396-7615-400b-9edc-9c7ad5b30f5a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:04.476361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3317396-7615-400b-9edc-9c7ad5b30f5a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:04.491363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:04.513774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d25b10-ecbb-44a5-ab00-ce35d89d2cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:04.514578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d25b10-ecbb-44a5-ab00-ce35d89d2cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:04.514859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d25b10-ecbb-44a5-ab00-ce35d89d2cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:04.515134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d25b10-ecbb-44a5-ab00-ce35d89d2cc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:04.526040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d25b10-ecbb-44a5-ab00-ce35d89d2cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-87d25b10-ecbb-44a5-ab00-ce35d89d2cc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:04.533848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:04.534944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:04.535794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 302/610] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:04.540999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c7bd8-0cc6-46da-af81-0c233b93cd42 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:04.623811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:04.653466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c7bd8-0cc6-46da-af81-0c233b93cd42 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:04.696219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef78198-43be-453e-a943-63c4217a85cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:04.696896 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef78198-43be-453e-a943-63c4217a85cf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:04.697178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef78198-43be-453e-a943-63c4217a85cf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:04.697452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef78198-43be-453e-a943-63c4217a85cf None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:04.698210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef78198-43be-453e-a943-63c4217a85cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:04.698516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef78198-43be-453e-a943-63c4217a85cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:04.699878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef78198-43be-453e-a943-63c4217a85cf None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:04.711653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 309/611] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:04.716984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d25b10-ecbb-44a5-ab00-ce35d89d2cc5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:04.871646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d25b10-ecbb-44a5-ab00-ce35d89d2cc5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:04.921712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ffb08-f4f0-4642-b711-7b84ff5aceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:04.922868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ffb08-f4f0-4642-b711-7b84ff5aceba None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:04.923362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ffb08-f4f0-4642-b711-7b84ff5aceba None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:04.923837 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ffb08-f4f0-4642-b711-7b84ff5aceba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:04.930061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67a663-602f-4562-94f8-14b64fd177f4 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:04.930353 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67a663-602f-4562-94f8-14b64fd177f4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:04.930633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67a663-602f-4562-94f8-14b64fd177f4 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:04.933235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 310/612] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:04.937286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0201c-4a52-47a2-bd6c-9285c593272a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:04.937576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0201c-4a52-47a2-bd6c-9285c593272a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:04.937860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0201c-4a52-47a2-bd6c-9285c593272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:04.940083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ffb08-f4f0-4642-b711-7b84ff5aceba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:04.942219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ffb08-f4f0-4642-b711-7b84ff5aceba None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:04.956320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e9e0201c-4a52-47a2-bd6c-9285c593272a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:04.958001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e9e0201c-4a52-47a2-bd6c-9285c593272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9c7ffb08-f4f0-4642-b711-7b84ff5aceba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:04.961645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:04.962488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:04.963361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:04.963361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:04.963361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:04.963361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:04.965179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 303/613] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:04.970226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ffb08-f4f0-4642-b711-7b84ff5aceba None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:05.010735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:05.047127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 311/614] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:59:05.084741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0201c-4a52-47a2-bd6c-9285c593272a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:05.142057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ffb08-f4f0-4642-b711-7b84ff5aceba None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:05.166626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:05.201700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0201c-4a52-47a2-bd6c-9285c593272a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:05.202904 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aed891-6361-45ec-91f1-58fa7a017c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:05.203577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed891-6361-45ec-91f1-58fa7a017c0b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:05.203860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed891-6361-45ec-91f1-58fa7a017c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:05.204173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed891-6361-45ec-91f1-58fa7a017c0b None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:05.204901 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aed891-6361-45ec-91f1-58fa7a017c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:05.205208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aed891-6361-45ec-91f1-58fa7a017c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:05.207109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aed891-6361-45ec-91f1-58fa7a017c0b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:05.228181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 304/615] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:05.233857 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aed891-6361-45ec-91f1-58fa7a017c0b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:05.241612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79790a4-e65e-41df-8b1d-2657624bb228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:05.243022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79790a4-e65e-41df-8b1d-2657624bb228 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:05.243359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79790a4-e65e-41df-8b1d-2657624bb228 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:05.243644 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79790a4-e65e-41df-8b1d-2657624bb228 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:05.264771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79790a4-e65e-41df-8b1d-2657624bb228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c79790a4-e65e-41df-8b1d-2657624bb228 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:05.280079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:05.282211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:05.284340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 312/616] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:05.306029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79790a4-e65e-41df-8b1d-2657624bb228 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:05.373500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:05.392899 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aed891-6361-45ec-91f1-58fa7a017c0b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:05.435425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be62e2-5df0-4832-b69c-1b3e2be05409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:05.437944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be62e2-5df0-4832-b69c-1b3e2be05409 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:05.438234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be62e2-5df0-4832-b69c-1b3e2be05409 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:05.438517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be62e2-5df0-4832-b69c-1b3e2be05409 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:05.452229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be62e2-5df0-4832-b69c-1b3e2be05409 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:05.453881 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be62e2-5df0-4832-b69c-1b3e2be05409 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b8be62e2-5df0-4832-b69c-1b3e2be05409 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:05.478090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:05.479065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:05.480004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:05.483638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 305/617] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:05.490388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be62e2-5df0-4832-b69c-1b3e2be05409 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:05.537575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79790a4-e65e-41df-8b1d-2657624bb228 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:05.596478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:05.603234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5835ec-fed2-444d-a722-e862f7127439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:05.603938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5835ec-fed2-444d-a722-e862f7127439 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:05.604282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5835ec-fed2-444d-a722-e862f7127439 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:05.604553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5835ec-fed2-444d-a722-e862f7127439 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:05.605326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5835ec-fed2-444d-a722-e862f7127439 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:05.605631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5835ec-fed2-444d-a722-e862f7127439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:05.607016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5835ec-fed2-444d-a722-e862f7127439 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:05.623100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 313/618] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:05.629181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5835ec-fed2-444d-a722-e862f7127439 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:05.663190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be62e2-5df0-4832-b69c-1b3e2be05409 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:05.733051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9267be6-76cd-4971-add6-a36726f483c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:05.733733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9267be6-76cd-4971-add6-a36726f483c0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:05.734018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9267be6-76cd-4971-add6-a36726f483c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:05.734294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9267be6-76cd-4971-add6-a36726f483c0 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:05.735136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9267be6-76cd-4971-add6-a36726f483c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:05.735443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9267be6-76cd-4971-add6-a36726f483c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:05.736911 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9267be6-76cd-4971-add6-a36726f483c0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:05.768094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 306/619] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 21:59:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:05.780959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9267be6-76cd-4971-add6-a36726f483c0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:05.784042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:05.799160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5835ec-fed2-444d-a722-e862f7127439 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:05.836955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe5a93-70a9-4a29-8df2-66a11d3e14d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:05.837891 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe5a93-70a9-4a29-8df2-66a11d3e14d8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:05.838187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe5a93-70a9-4a29-8df2-66a11d3e14d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:05.838468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe5a93-70a9-4a29-8df2-66a11d3e14d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:05.850124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe5a93-70a9-4a29-8df2-66a11d3e14d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:05.851944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe5a93-70a9-4a29-8df2-66a11d3e14d8 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-d0fe5a93-70a9-4a29-8df2-66a11d3e14d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:05.871217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:05.872313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:05.873191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:05.873191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:05.873191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:05.873191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:05.873191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 314/620] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:05.877894 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe5a93-70a9-4a29-8df2-66a11d3e14d8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:05.976323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:05.976639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9267be6-76cd-4971-add6-a36726f483c0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.023445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad4f11-dc15-4722-bb05-7878b78134a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.024624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad4f11-dc15-4722-bb05-7878b78134a9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.025058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad4f11-dc15-4722-bb05-7878b78134a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.025529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad4f11-dc15-4722-bb05-7878b78134a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.028190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe5a93-70a9-4a29-8df2-66a11d3e14d8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.037108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad4f11-dc15-4722-bb05-7878b78134a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.038852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad4f11-dc15-4722-bb05-7878b78134a9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4dad4f11-dc15-4722-bb05-7878b78134a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:06.057720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:06.058732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:06.059739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:06.059739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:06.059739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:06.059739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:06.061651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 307/621] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:06.067700 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002201c1-59cb-4630-aaa2-42b43bb12e0b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.067847 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f954d77-c0b6-4b58-98bb-5dd63ff2a220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.067847 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f954d77-c0b6-4b58-98bb-5dd63ff2a220 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.067847 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f954d77-c0b6-4b58-98bb-5dd63ff2a220 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.067847 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f954d77-c0b6-4b58-98bb-5dd63ff2a220 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.068208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f954d77-c0b6-4b58-98bb-5dd63ff2a220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:06.068208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f954d77-c0b6-4b58-98bb-5dd63ff2a220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.068208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f954d77-c0b6-4b58-98bb-5dd63ff2a220 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.068811 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002201c1-59cb-4630-aaa2-42b43bb12e0b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.069279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002201c1-59cb-4630-aaa2-42b43bb12e0b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.071218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 308/622] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:06.072110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002201c1-59cb-4630-aaa2-42b43bb12e0b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:06.087677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 315/623] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:06.089164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8266007-3014-4edd-bdfd-e002f248e837 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.089454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8266007-3014-4edd-bdfd-e002f248e837 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.090095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8266007-3014-4edd-bdfd-e002f248e837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.107878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d8266007-3014-4edd-bdfd-e002f248e837 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:06.109205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d8266007-3014-4edd-bdfd-e002f248e837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:06.145437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:06.192088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 316/624] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:06.193209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8266007-3014-4edd-bdfd-e002f248e837 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:06.195851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002201c1-59cb-4630-aaa2-42b43bb12e0b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.246277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:06.248444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c481-83cf-48fb-829d-5024097c4b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.249646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c481-83cf-48fb-829d-5024097c4b9c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.250193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c481-83cf-48fb-829d-5024097c4b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.250630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c481-83cf-48fb-829d-5024097c4b9c None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.251518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c481-83cf-48fb-829d-5024097c4b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:06.252075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c481-83cf-48fb-829d-5024097c4b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.255507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c481-83cf-48fb-829d-5024097c4b9c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.274049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 309/625] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:06.275299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c481-83cf-48fb-829d-5024097c4b9c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:06.322976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8266007-3014-4edd-bdfd-e002f248e837 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.359717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bc643-6e3f-4c39-86e4-c49532d814f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.360792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bc643-6e3f-4c39-86e4-c49532d814f4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.360923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bc643-6e3f-4c39-86e4-c49532d814f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.361176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bc643-6e3f-4c39-86e4-c49532d814f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.369414 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bc643-6e3f-4c39-86e4-c49532d814f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.371417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bc643-6e3f-4c39-86e4-c49532d814f4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.384444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c481-83cf-48fb-829d-5024097c4b9c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-cb9bc643-6e3f-4c39-86e4-c49532d814f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:06.387723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:06.388950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:06.390058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 317/626] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 21:59:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:06.390681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bc643-6e3f-4c39-86e4-c49532d814f4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:06.403470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:06.426721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea295b10-dd8a-463d-8ca0-4b5cce72ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.427785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea295b10-dd8a-463d-8ca0-4b5cce72ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.428253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea295b10-dd8a-463d-8ca0-4b5cce72ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.428694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea295b10-dd8a-463d-8ca0-4b5cce72ffe6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.439919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea295b10-dd8a-463d-8ca0-4b5cce72ffe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-ea295b10-dd8a-463d-8ca0-4b5cce72ffe6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:06.449375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:06.450469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:06.451410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:06.453845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 310/627] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:06.454817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea295b10-dd8a-463d-8ca0-4b5cce72ffe6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:06.499448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:06.506150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bc643-6e3f-4c39-86e4-c49532d814f4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.543361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a82f3-4e8d-434a-a2d2-5809beae180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.544254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a82f3-4e8d-434a-a2d2-5809beae180e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.544485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a82f3-4e8d-434a-a2d2-5809beae180e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.544764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a82f3-4e8d-434a-a2d2-5809beae180e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.554480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a82f3-4e8d-434a-a2d2-5809beae180e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.556123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a82f3-4e8d-434a-a2d2-5809beae180e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.568743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea295b10-dd8a-463d-8ca0-4b5cce72ffe6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-0c6a82f3-4e8d-434a-a2d2-5809beae180e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:06.572401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:06.573461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:06.574442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:06.574442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:06.574442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:06.574442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:06.574442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:06.574442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:06.574442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:06.574442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:06.578455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 318/628] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:06.579405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a82f3-4e8d-434a-a2d2-5809beae180e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:06.608131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873779c-1d52-4592-ad74-8674b6affbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.609171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873779c-1d52-4592-ad74-8674b6affbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.609612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873779c-1d52-4592-ad74-8674b6affbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.610096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873779c-1d52-4592-ad74-8674b6affbf0 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.611089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873779c-1d52-4592-ad74-8674b6affbf0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:06.611566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873779c-1d52-4592-ad74-8674b6affbf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.613973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873779c-1d52-4592-ad74-8674b6affbf0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.633024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 311/629] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 21:59:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:06.634193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873779c-1d52-4592-ad74-8674b6affbf0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:06.665374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:06.692177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a82f3-4e8d-434a-a2d2-5809beae180e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.725621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a534eb1-5243-41f3-a6f2-97943446792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.726297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534eb1-5243-41f3-a6f2-97943446792f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.726591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534eb1-5243-41f3-a6f2-97943446792f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.726874 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534eb1-5243-41f3-a6f2-97943446792f None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.727631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a534eb1-5243-41f3-a6f2-97943446792f None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:06.727973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a534eb1-5243-41f3-a6f2-97943446792f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.729341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a534eb1-5243-41f3-a6f2-97943446792f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.737781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 319/630] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:06.738364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873779c-1d52-4592-ad74-8674b6affbf0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.739005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7edc2-803a-40f2-a904-207f0d6bb871 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.739295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7edc2-803a-40f2-a904-207f0d6bb871 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.739576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7edc2-803a-40f2-a904-207f0d6bb871 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.741200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 320/631] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:06.741539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7edc2-803a-40f2-a904-207f0d6bb871 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:06.760337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:06.776641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c815f-ef26-40e4-94dc-6985660aad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.777309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c815f-ef26-40e4-94dc-6985660aad87 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.777598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c815f-ef26-40e4-94dc-6985660aad87 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.777885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c815f-ef26-40e4-94dc-6985660aad87 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.778675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c815f-ef26-40e4-94dc-6985660aad87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:06.778988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c815f-ef26-40e4-94dc-6985660aad87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.780442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c815f-ef26-40e4-94dc-6985660aad87 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.792388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 312/632] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:06.793748 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b018-911b-496f-8dcb-a14b5888427a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.793991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b018-911b-496f-8dcb-a14b5888427a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.794286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b018-911b-496f-8dcb-a14b5888427a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.799458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 313/633] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:06.799458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262b018-911b-496f-8dcb-a14b5888427a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:06.844726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7edc2-803a-40f2-a904-207f0d6bb871 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.877420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb0cea-8332-481a-9f99-21fb03fc8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.878091 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb0cea-8332-481a-9f99-21fb03fc8694 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.878372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb0cea-8332-481a-9f99-21fb03fc8694 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.878647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb0cea-8332-481a-9f99-21fb03fc8694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.888467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:06.898651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262b018-911b-496f-8dcb-a14b5888427a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:06.931776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c53fec-b8cb-464d-afdf-68c00cd39d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:06.932582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c53fec-b8cb-464d-afdf-68c00cd39d4b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.932864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c53fec-b8cb-464d-afdf-68c00cd39d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.933137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c53fec-b8cb-464d-afdf-68c00cd39d4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.942958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c53fec-b8cb-464d-afdf-68c00cd39d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.943954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb0cea-8332-481a-9f99-21fb03fc8694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:06.944416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c53fec-b8cb-464d-afdf-68c00cd39d4b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.945395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb0cea-8332-481a-9f99-21fb03fc8694 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-06c53fec-b8cb-464d-afdf-68c00cd39d4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:06.962093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:06.963153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:06.964074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:06.964074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:06.964074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:06.964074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:06.964074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 314/634] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:06.965151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b323212-cbdd-4f3a-9ec4-170cb956a4c4 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:06.965151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b323212-cbdd-4f3a-9ec4-170cb956a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:06.965151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b323212-cbdd-4f3a-9ec4-170cb956a4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:06.966650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:06.981892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4b323212-cbdd-4f3a-9ec4-170cb956a4c4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:06.983065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4b323212-cbdd-4f3a-9ec4-170cb956a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:07.045194 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 321/635] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:59:07.045924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb0cea-8332-481a-9f99-21fb03fc8694 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.056168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 315/636] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:07.056168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5036ea7-f8e2-4802-9083-afd57d13041c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.056168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5036ea7-f8e2-4802-9083-afd57d13041c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.056168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5036ea7-f8e2-4802-9083-afd57d13041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.074617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f5036ea7-f8e2-4802-9083-afd57d13041c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:07.075782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f5036ea7-f8e2-4802-9083-afd57d13041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:07.146788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 316/637] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:07.147720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5036ea7-f8e2-4802-9083-afd57d13041c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.163258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb0cea-8332-481a-9f99-21fb03fc8694 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.170085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:07.180914 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:07.197308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99371c02-a6da-4e14-b2ba-51e97cfff575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:07.198203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99371c02-a6da-4e14-b2ba-51e97cfff575 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.198490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99371c02-a6da-4e14-b2ba-51e97cfff575 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.198769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99371c02-a6da-4e14-b2ba-51e97cfff575 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/2695a36b9b38450981588c31c2b9afc7/roles/c45ff064e30a4a689212d6aee4ed3dd7` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.212957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99371c02-a6da-4e14-b2ba-51e97cfff575 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=2695a36b9b38450981588c31c2b9afc7, role_id=c45ff064e30a4a689212d6aee4ed3dd7)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:07.214382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99371c02-a6da-4e14-b2ba-51e97cfff575 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:07.226879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 322/638] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:07 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/2695a36b9b38450981588c31c2b9afc7/roles/c45ff064e30a4a689212d6aee4ed3dd7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:59:07.227667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99371c02-a6da-4e14-b2ba-51e97cfff575 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.254217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5036ea7-f8e2-4802-9083-afd57d13041c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.293754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628968-b45c-4a5f-92fb-37b8d30a7d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:07.294446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628968-b45c-4a5f-92fb-37b8d30a7d8e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.294747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628968-b45c-4a5f-92fb-37b8d30a7d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.295018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628968-b45c-4a5f-92fb-37b8d30a7d8e None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.295812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628968-b45c-4a5f-92fb-37b8d30a7d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:07.296176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628968-b45c-4a5f-92fb-37b8d30a7d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:07.297593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628968-b45c-4a5f-92fb-37b8d30a7d8e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:07.314682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 317/639] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:07.317246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628968-b45c-4a5f-92fb-37b8d30a7d8e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.367317 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99371c02-a6da-4e14-b2ba-51e97cfff575 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.394408 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:07.410082 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd107e-367f-4ce8-a792-e970f727aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:07.410899 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd107e-367f-4ce8-a792-e970f727aecb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.411187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd107e-367f-4ce8-a792-e970f727aecb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.411461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd107e-367f-4ce8-a792-e970f727aecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.421968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd107e-367f-4ce8-a792-e970f727aecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:07.423448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd107e-367f-4ce8-a792-e970f727aecb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:07.438130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628968-b45c-4a5f-92fb-37b8d30a7d8e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-76fd107e-367f-4ce8-a792-e970f727aecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:07.442009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:07.442991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:07.444185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:07.444185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:07.444185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:07.444185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:07.444185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 323/640] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:07.444185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd107e-367f-4ce8-a792-e970f727aecb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.476514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:07.486217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2411a8-7308-4021-af61-3e0f790a91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:07.487605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2411a8-7308-4021-af61-3e0f790a91b8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.487888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2411a8-7308-4021-af61-3e0f790a91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.488239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2411a8-7308-4021-af61-3e0f790a91b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.498828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2411a8-7308-4021-af61-3e0f790a91b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-7a2411a8-7308-4021-af61-3e0f790a91b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:07.507152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:07.508086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:07.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 318/641] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:07.509787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2411a8-7308-4021-af61-3e0f790a91b8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.571695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd107e-367f-4ce8-a792-e970f727aecb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.610522 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7228a-d0f5-4019-8551-fd8976de13b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:07.611393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7228a-d0f5-4019-8551-fd8976de13b7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.611666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7228a-d0f5-4019-8551-fd8976de13b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.611889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7228a-d0f5-4019-8551-fd8976de13b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.622782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2411a8-7308-4021-af61-3e0f790a91b8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.623505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7228a-d0f5-4019-8551-fd8976de13b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-94c7228a-d0f5-4019-8551-fd8976de13b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:07.638518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:07.639561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:07.640447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:07.641683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 324/642] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:07.642097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7228a-d0f5-4019-8551-fd8976de13b7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.654323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:07.667651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354705-3c40-41c1-833c-058c694cc775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:07.668638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354705-3c40-41c1-833c-058c694cc775 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.668926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354705-3c40-41c1-833c-058c694cc775 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.669207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354705-3c40-41c1-833c-058c694cc775 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.680452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354705-3c40-41c1-833c-058c694cc775 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:07.682492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354705-3c40-41c1-833c-058c694cc775 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-29354705-3c40-41c1-833c-058c694cc775 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:07.700314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:07.701308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:07.702304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 319/643] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:07.703006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354705-3c40-41c1-833c-058c694cc775 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.766907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:07.788069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7228a-d0f5-4019-8551-fd8976de13b7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.821303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357e467-138e-4447-92b8-3a8932d9d5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:07.822033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357e467-138e-4447-92b8-3a8932d9d5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.822269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357e467-138e-4447-92b8-3a8932d9d5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.822552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357e467-138e-4447-92b8-3a8932d9d5e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.823282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357e467-138e-4447-92b8-3a8932d9d5e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:07.823597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357e467-138e-4447-92b8-3a8932d9d5e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:07.825038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357e467-138e-4447-92b8-3a8932d9d5e6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:07.833347 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354705-3c40-41c1-833c-058c694cc775 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.837818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 325/644] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:07.838633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357e467-138e-4447-92b8-3a8932d9d5e6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.869737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae48c4-271c-4535-b232-ce85a8b20f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:07.870410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae48c4-271c-4535-b232-ce85a8b20f9b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.870702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae48c4-271c-4535-b232-ce85a8b20f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.870986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae48c4-271c-4535-b232-ce85a8b20f9b None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.871738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae48c4-271c-4535-b232-ce85a8b20f9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:07.872076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae48c4-271c-4535-b232-ce85a8b20f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:07.873434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae48c4-271c-4535-b232-ce85a8b20f9b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:07.886487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 320/645] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:07.886487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae48c4-271c-4535-b232-ce85a8b20f9b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:07.933485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:07.957830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357e467-138e-4447-92b8-3a8932d9d5e6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.995540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca3e7b-df7c-48e5-a961-b96e49da4cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:07.996244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca3e7b-df7c-48e5-a961-b96e49da4cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:07.996539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca3e7b-df7c-48e5-a961-b96e49da4cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:07.996823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca3e7b-df7c-48e5-a961-b96e49da4cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:07.996979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae48c4-271c-4535-b232-ce85a8b20f9b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:07.997580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca3e7b-df7c-48e5-a961-b96e49da4cc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:07.997892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca3e7b-df7c-48e5-a961-b96e49da4cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:07.999261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca3e7b-df7c-48e5-a961-b96e49da4cc4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.008313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 326/646] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:08.009118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca3e7b-df7c-48e5-a961-b96e49da4cc4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.011755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:08.040425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f93d23-c0e3-4bb8-a1b6-853464c2ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.041103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f93d23-c0e3-4bb8-a1b6-853464c2ab14 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.041388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f93d23-c0e3-4bb8-a1b6-853464c2ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.041670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f93d23-c0e3-4bb8-a1b6-853464c2ab14 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.042515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f93d23-c0e3-4bb8-a1b6-853464c2ab14 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:08.042834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f93d23-c0e3-4bb8-a1b6-853464c2ab14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.044290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f93d23-c0e3-4bb8-a1b6-853464c2ab14 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.063204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 321/647] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 21:59:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:08.064046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f93d23-c0e3-4bb8-a1b6-853464c2ab14 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.121240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca3e7b-df7c-48e5-a961-b96e49da4cc4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:08.159555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57f99c-2c32-434a-b772-afb9aff621a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.160448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57f99c-2c32-434a-b772-afb9aff621a3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.160743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57f99c-2c32-434a-b772-afb9aff621a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.161021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57f99c-2c32-434a-b772-afb9aff621a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.167731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57f99c-2c32-434a-b772-afb9aff621a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.169205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57f99c-2c32-434a-b772-afb9aff621a3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.176504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f93d23-c0e3-4bb8-a1b6-853464c2ab14 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:08.179513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9c57f99c-2c32-434a-b772-afb9aff621a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:08.184601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:08.186087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:08.186985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:08.186985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:08.186985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:08.186985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:08.186985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:08.186985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:08.186985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:08.186985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:08.186985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 327/648] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:08.187487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57f99c-2c32-434a-b772-afb9aff621a3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.219642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7f3d1-3ccf-429c-ad26-6539138ed8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.222422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7f3d1-3ccf-429c-ad26-6539138ed8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.222724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7f3d1-3ccf-429c-ad26-6539138ed8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.222990 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7f3d1-3ccf-429c-ad26-6539138ed8f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.233739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7f3d1-3ccf-429c-ad26-6539138ed8f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.236107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7f3d1-3ccf-429c-ad26-6539138ed8f2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-02a7f3d1-3ccf-429c-ad26-6539138ed8f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:08.255256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:08.256794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:08.257673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:08.257673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:08.257673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:08.257673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:08.257673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 322/649] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:08.257673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7f3d1-3ccf-429c-ad26-6539138ed8f2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.263229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:08.304738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57f99c-2c32-434a-b772-afb9aff621a3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:08.343214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4473be5-0566-4963-826b-0bebb8a99eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.344042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4473be5-0566-4963-826b-0bebb8a99eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.344333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4473be5-0566-4963-826b-0bebb8a99eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.344609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4473be5-0566-4963-826b-0bebb8a99eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.355688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4473be5-0566-4963-826b-0bebb8a99eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.357189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4473be5-0566-4963-826b-0bebb8a99eb1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.363373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7f3d1-3ccf-429c-ad26-6539138ed8f2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-a4473be5-0566-4963-826b-0bebb8a99eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:08.375945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:08.376909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:08.377905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:08.377905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:08.377905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:08.377905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:08.377905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 328/650] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:08.378628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4473be5-0566-4963-826b-0bebb8a99eb1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.407280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915210-b7c6-4d38-93fa-df7dc7912257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.408079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915210-b7c6-4d38-93fa-df7dc7912257 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.408366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915210-b7c6-4d38-93fa-df7dc7912257 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.408648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915210-b7c6-4d38-93fa-df7dc7912257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.436511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:08.483025 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915210-b7c6-4d38-93fa-df7dc7912257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.483611 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4473be5-0566-4963-826b-0bebb8a99eb1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:08.484522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915210-b7c6-4d38-93fa-df7dc7912257 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.498902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:08.523836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7733a9-8d4b-41ac-969f-132367ac58b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.524530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7733a9-8d4b-41ac-969f-132367ac58b3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.524813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7733a9-8d4b-41ac-969f-132367ac58b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.525093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7733a9-8d4b-41ac-969f-132367ac58b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.526296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7733a9-8d4b-41ac-969f-132367ac58b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:08.526610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7733a9-8d4b-41ac-969f-132367ac58b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.528442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7733a9-8d4b-41ac-969f-132367ac58b3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.550691 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 329/651] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:08.550691 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7733a9-8d4b-41ac-969f-132367ac58b3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.607106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 323/652] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:59:08.607985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915210-b7c6-4d38-93fa-df7dc7912257 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.652643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7733a9-8d4b-41ac-969f-132367ac58b3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:08.666839 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:08.688642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e2e0d-81e2-4995-842d-8aa696fc3494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.689298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2e0d-81e2-4995-842d-8aa696fc3494 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.689584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2e0d-81e2-4995-842d-8aa696fc3494 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.689858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2e0d-81e2-4995-842d-8aa696fc3494 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.691115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e2e0d-81e2-4995-842d-8aa696fc3494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:08.691419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e2e0d-81e2-4995-842d-8aa696fc3494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.692811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e2e0d-81e2-4995-842d-8aa696fc3494 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.704253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 330/653] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:08.705032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e2e0d-81e2-4995-842d-8aa696fc3494 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.721169 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915210-b7c6-4d38-93fa-df7dc7912257 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:08.738555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:08.762527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2650-1ca7-4686-b178-487c211898dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.763314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2650-1ca7-4686-b178-487c211898dd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.763603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2650-1ca7-4686-b178-487c211898dd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.763879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2650-1ca7-4686-b178-487c211898dd None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.764637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2650-1ca7-4686-b178-487c211898dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:08.764946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2650-1ca7-4686-b178-487c211898dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.766534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2650-1ca7-4686-b178-487c211898dd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.783695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 324/654] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:08.783695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2650-1ca7-4686-b178-487c211898dd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.812965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e2e0d-81e2-4995-842d-8aa696fc3494 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:08.849318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1004c9-baea-495c-9471-8235d03d0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.849987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1004c9-baea-495c-9471-8235d03d0288 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.850275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1004c9-baea-495c-9471-8235d03d0288 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.850555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1004c9-baea-495c-9471-8235d03d0288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.851399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1004c9-baea-495c-9471-8235d03d0288 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=44e6d786ac4a40468794b18cfedfa730) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:08.851716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1004c9-baea-495c-9471-8235d03d0288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.853285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1004c9-baea-495c-9471-8235d03d0288 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.859364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 331/655] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/role_assignments?user.id=44e6d786ac4a40468794b18cfedfa730&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:08.860095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1004c9-baea-495c-9471-8235d03d0288 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:08.901971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2650-1ca7-4686-b178-487c211898dd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:08.927257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:08.951494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aac69b-6ca3-48b1-a9bb-693547035206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:08.952535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aac69b-6ca3-48b1-a9bb-693547035206 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:08.952753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aac69b-6ca3-48b1-a9bb-693547035206 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:08.953009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aac69b-6ca3-48b1-a9bb-693547035206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:08.966267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aac69b-6ca3-48b1-a9bb-693547035206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:08.967590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aac69b-6ca3-48b1-a9bb-693547035206 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-17aac69b-6ca3-48b1-a9bb-693547035206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:08.987035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:08.988426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:08.989323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:08.989323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:08.989323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:08.989323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:08.989323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 325/656] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:08.989323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aac69b-6ca3-48b1-a9bb-693547035206 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:09.002008 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:09.007724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1004c9-baea-495c-9471-8235d03d0288 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:09.055341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910a568-c4ee-4330-acff-c0c9444b1570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:09.056741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a568-c4ee-4330-acff-c0c9444b1570 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.057213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a568-c4ee-4330-acff-c0c9444b1570 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.057684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a568-c4ee-4330-acff-c0c9444b1570 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.066038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a568-c4ee-4330-acff-c0c9444b1570 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:09.067489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a568-c4ee-4330-acff-c0c9444b1570 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-5910a568-c4ee-4330-acff-c0c9444b1570 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:09.084017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:09.084963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 21:59:09.085902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:09.086994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 332/657] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:09.087804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910a568-c4ee-4330-acff-c0c9444b1570 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:09.115611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aac69b-6ca3-48b1-a9bb-693547035206 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:09.161379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13dfb-aec7-4c10-a238-58ef93c31236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:09.161716 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13dfb-aec7-4c10-a238-58ef93c31236 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.161976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13dfb-aec7-4c10-a238-58ef93c31236 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.162250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13dfb-aec7-4c10-a238-58ef93c31236 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.173831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f13dfb-aec7-4c10-a238-58ef93c31236 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:09.173831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f13dfb-aec7-4c10-a238-58ef93c31236 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-39f13dfb-aec7-4c10-a238-58ef93c31236 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:09.190150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:09.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 21:59:09.192319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:09.196001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 326/658] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:09.197617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13dfb-aec7-4c10-a238-58ef93c31236 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:09.225396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910a568-c4ee-4330-acff-c0c9444b1570 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:09.235869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:09.269373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa643e-57ed-4ca6-b76c-ffc3e04e0be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:09.270122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa643e-57ed-4ca6-b76c-ffc3e04e0be4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.270413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa643e-57ed-4ca6-b76c-ffc3e04e0be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.270696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa643e-57ed-4ca6-b76c-ffc3e04e0be4 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.271436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa643e-57ed-4ca6-b76c-ffc3e04e0be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:09.271749 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa643e-57ed-4ca6-b76c-ffc3e04e0be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:09.273961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa643e-57ed-4ca6-b76c-ffc3e04e0be4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:09.290049 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 333/659] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:09.291111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa643e-57ed-4ca6-b76c-ffc3e04e0be4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:09.314138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:09.333805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13dfb-aec7-4c10-a238-58ef93c31236 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:09.383644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee0768-a694-4fea-8cea-5deafb6c171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:09.384718 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee0768-a694-4fea-8cea-5deafb6c171c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.385001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee0768-a694-4fea-8cea-5deafb6c171c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.385278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee0768-a694-4fea-8cea-5deafb6c171c None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.386596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee0768-a694-4fea-8cea-5deafb6c171c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:09.386909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee0768-a694-4fea-8cea-5deafb6c171c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:09.388751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee0768-a694-4fea-8cea-5deafb6c171c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:09.407890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 327/660] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 21:59:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:09.409685 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee0768-a694-4fea-8cea-5deafb6c171c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:09.416889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa643e-57ed-4ca6-b76c-ffc3e04e0be4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:09.460111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acd578-d573-407f-88c4-3c417452f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:09.461023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acd578-d573-407f-88c4-3c417452f033 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.461309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acd578-d573-407f-88c4-3c417452f033 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.461591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acd578-d573-407f-88c4-3c417452f033 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.462443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acd578-d573-407f-88c4-3c417452f033 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:09.462758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acd578-d573-407f-88c4-3c417452f033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:09.464961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acd578-d573-407f-88c4-3c417452f033 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:09.488669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 334/661] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jul 13 21:59:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:09.490992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4939d-7a6c-41a7-9fb9-9d7c2f14a805 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.491287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4939d-7a6c-41a7-9fb9-9d7c2f14a805 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.491568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4939d-7a6c-41a7-9fb9-9d7c2f14a805 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.493047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 335/662] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:09.497388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:09.497664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4939d-7a6c-41a7-9fb9-9d7c2f14a805 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:09.513452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee0768-a694-4fea-8cea-5deafb6c171c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:09.550609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf4de1-f5e8-441c-b8ae-63bc15fa5a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:09.551409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf4de1-f5e8-441c-b8ae-63bc15fa5a24 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.551699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf4de1-f5e8-441c-b8ae-63bc15fa5a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.552012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf4de1-f5e8-441c-b8ae-63bc15fa5a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.559720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf4de1-f5e8-441c-b8ae-63bc15fa5a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:09.561190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf4de1-f5e8-441c-b8ae-63bc15fa5a24 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b6cf4de1-f5e8-441c-b8ae-63bc15fa5a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:09.575056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:09.576201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 328/663] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:09.582314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf4de1-f5e8-441c-b8ae-63bc15fa5a24 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:09.587117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:09.613661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4939d-7a6c-41a7-9fb9-9d7c2f14a805 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:09.652909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503cc31-bc4b-4957-8937-3281378507e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:09.653564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503cc31-bc4b-4957-8937-3281378507e2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.653855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503cc31-bc4b-4957-8937-3281378507e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.654144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503cc31-bc4b-4957-8937-3281378507e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.691272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf4de1-f5e8-441c-b8ae-63bc15fa5a24 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:09.725908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503cc31-bc4b-4957-8937-3281378507e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:09.727497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503cc31-bc4b-4957-8937-3281378507e2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:09.728247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee91d4-b769-4e11-9efb-86b8a1e3ae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:09.729158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee91d4-b769-4e11-9efb-86b8a1e3ae30 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.729453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee91d4-b769-4e11-9efb-86b8a1e3ae30 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.729736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee91d4-b769-4e11-9efb-86b8a1e3ae30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.745697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:09.806705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee91d4-b769-4e11-9efb-86b8a1e3ae30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:09.808771 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee91d4-b769-4e11-9efb-86b8a1e3ae30 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:09.810708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:09.840321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 336/664] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:59:09.840321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe0a5-3a2e-4c87-9860-84934b25b2c5 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:09.840321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe0a5-3a2e-4c87-9860-84934b25b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:09.840321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe0a5-3a2e-4c87-9860-84934b25b2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:09.854672 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-983fe0a5-3a2e-4c87-9860-84934b25b2c5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:09.855995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-983fe0a5-3a2e-4c87-9860-84934b25b2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:09.935924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 337/665] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:09.935924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe0a5-3a2e-4c87-9860-84934b25b2c5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:09.948063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 329/666] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:59:09.948971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee91d4-b769-4e11-9efb-86b8a1e3ae30 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:09.999358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:10.037691 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe0a5-3a2e-4c87-9860-84934b25b2c5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.045823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:10.059706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee91d4-b769-4e11-9efb-86b8a1e3ae30 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.076190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c58a59-c9af-47f9-b277-c20234ce8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.077097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c58a59-c9af-47f9-b277-c20234ce8d37 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.077544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c58a59-c9af-47f9-b277-c20234ce8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.078078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c58a59-c9af-47f9-b277-c20234ce8d37 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.079129 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c58a59-c9af-47f9-b277-c20234ce8d37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:10.079593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c58a59-c9af-47f9-b277-c20234ce8d37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:10.081263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c58a59-c9af-47f9-b277-c20234ce8d37 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:10.095325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 338/667] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:10.096763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c58a59-c9af-47f9-b277-c20234ce8d37 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.102758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e51a6-6b35-4118-b0e0-165193d67110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.106205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e51a6-6b35-4118-b0e0-165193d67110 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.106205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e51a6-6b35-4118-b0e0-165193d67110 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.106205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e51a6-6b35-4118-b0e0-165193d67110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.116613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e51a6-6b35-4118-b0e0-165193d67110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:10.118067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e51a6-6b35-4118-b0e0-165193d67110 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a16e51a6-6b35-4118-b0e0-165193d67110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:10.137227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:10.138321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:10.139439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:10.139439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:10.139439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:10.139439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:10.143086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 330/668] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:10.143970 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e51a6-6b35-4118-b0e0-165193d67110 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.208465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c58a59-c9af-47f9-b277-c20234ce8d37 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.243144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4575b-9836-4e24-930f-7236f912a875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.243970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4575b-9836-4e24-930f-7236f912a875 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.244264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4575b-9836-4e24-930f-7236f912a875 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.244480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:10.244585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4575b-9836-4e24-930f-7236f912a875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.248413 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e51a6-6b35-4118-b0e0-165193d67110 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.256974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4575b-9836-4e24-930f-7236f912a875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:10.258243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4575b-9836-4e24-930f-7236f912a875 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c5f4575b-9836-4e24-930f-7236f912a875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:10.275681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:10.277157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:10.278050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:10.278050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:10.278050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:10.278050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:10.278050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 339/669] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:10.278050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4575b-9836-4e24-930f-7236f912a875 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.288690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a29f84-fef2-4d72-906a-2963aed05abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.289486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a29f84-fef2-4d72-906a-2963aed05abd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.289768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a29f84-fef2-4d72-906a-2963aed05abd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.290045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a29f84-fef2-4d72-906a-2963aed05abd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.300556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a29f84-fef2-4d72-906a-2963aed05abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:10.302803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-85a29f84-fef2-4d72-906a-2963aed05abd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:10.308277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:10.309213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:10.310051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 331/670] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:10.310731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a29f84-fef2-4d72-906a-2963aed05abd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.391199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4575b-9836-4e24-930f-7236f912a875 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.419590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a29f84-fef2-4d72-906a-2963aed05abd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.425807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ea8e1-7bb3-4ba7-910c-8ae2e12e5f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.426461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ea8e1-7bb3-4ba7-910c-8ae2e12e5f72 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.426743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ea8e1-7bb3-4ba7-910c-8ae2e12e5f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.427018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ea8e1-7bb3-4ba7-910c-8ae2e12e5f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.427850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ea8e1-7bb3-4ba7-910c-8ae2e12e5f72 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=b6d929086ac74f1bb5f323cca822fbbf) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:10.428195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ea8e1-7bb3-4ba7-910c-8ae2e12e5f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:10.429625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ea8e1-7bb3-4ba7-910c-8ae2e12e5f72 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:10.435872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 340/671] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/role_assignments?user.id=b6d929086ac74f1bb5f323cca822fbbf&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:10.436660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ea8e1-7bb3-4ba7-910c-8ae2e12e5f72 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.477654 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843a2b-2627-4ff6-9b96-19358f19c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.478778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843a2b-2627-4ff6-9b96-19358f19c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.479303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843a2b-2627-4ff6-9b96-19358f19c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.479761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843a2b-2627-4ff6-9b96-19358f19c1f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.480707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66843a2b-2627-4ff6-9b96-19358f19c1f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:10.481199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66843a2b-2627-4ff6-9b96-19358f19c1f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:10.483560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66843a2b-2627-4ff6-9b96-19358f19c1f1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:10.503848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 332/672] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:10.505744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843a2b-2627-4ff6-9b96-19358f19c1f1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.530976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:10.534499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:10.553495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ea8e1-7bb3-4ba7-910c-8ae2e12e5f72 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.599446 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb96813-501a-40f3-bdd6-f469d8eabb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.600150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96813-501a-40f3-bdd6-f469d8eabb3e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.600437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96813-501a-40f3-bdd6-f469d8eabb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.600717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96813-501a-40f3-bdd6-f469d8eabb3e None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.601454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb96813-501a-40f3-bdd6-f469d8eabb3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:10.601810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb96813-501a-40f3-bdd6-f469d8eabb3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:10.603152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb96813-501a-40f3-bdd6-f469d8eabb3e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:10.620664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 341/673] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:10.620974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb96813-501a-40f3-bdd6-f469d8eabb3e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.653114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843a2b-2627-4ff6-9b96-19358f19c1f1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.702466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3bf9b-02a4-41c7-86d5-e4dff45461b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.703288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3bf9b-02a4-41c7-86d5-e4dff45461b6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.703694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3bf9b-02a4-41c7-86d5-e4dff45461b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.704020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3bf9b-02a4-41c7-86d5-e4dff45461b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.705032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3bf9b-02a4-41c7-86d5-e4dff45461b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:10.705346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3bf9b-02a4-41c7-86d5-e4dff45461b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:10.708241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3bf9b-02a4-41c7-86d5-e4dff45461b6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:10.724003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 333/674] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:10.724917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3bf9b-02a4-41c7-86d5-e4dff45461b6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.755056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb96813-501a-40f3-bdd6-f469d8eabb3e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.794242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f71d17-763f-4026-9ec7-fca494e43ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.795462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f71d17-763f-4026-9ec7-fca494e43ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.796085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f71d17-763f-4026-9ec7-fca494e43ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.796565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f71d17-763f-4026-9ec7-fca494e43ef1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.804696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f71d17-763f-4026-9ec7-fca494e43ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:10.806616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f71d17-763f-4026-9ec7-fca494e43ef1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:10.811834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-52f71d17-763f-4026-9ec7-fca494e43ef1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:10.829937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:10.831164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:10.832761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:10.832761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:10.832761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:10.832761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:10.832761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:10.832761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:10.832761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:10.832761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:10.839359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3bf9b-02a4-41c7-86d5-e4dff45461b6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.839723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 342/675] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:10.840808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f71d17-763f-4026-9ec7-fca494e43ef1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.844122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:10.872525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6d81-291e-429b-8ba8-0648056e8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.873183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6d81-291e-429b-8ba8-0648056e8a4c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.873475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6d81-291e-429b-8ba8-0648056e8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:10.873803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6d81-291e-429b-8ba8-0648056e8a4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:10.881525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b6d81-291e-429b-8ba8-0648056e8a4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:10.883039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b6d81-291e-429b-8ba8-0648056e8a4c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-412b6d81-291e-429b-8ba8-0648056e8a4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:10.898258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:10.899172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:10.900484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:10.900484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:10.900484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:10.900484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:10.900484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:10.900484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:10.900484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:10.900484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:10.900484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 334/676] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:10.904531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6d81-291e-429b-8ba8-0648056e8a4c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:10.959715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f71d17-763f-4026-9ec7-fca494e43ef1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:10.998615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3897a-3baa-4e6f-bd00-c5dce9fd3f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:10.999414 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3897a-3baa-4e6f-bd00-c5dce9fd3f2f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:10.999701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3897a-3baa-4e6f-bd00-c5dce9fd3f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.000024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3897a-3baa-4e6f-bd00-c5dce9fd3f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.011574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3897a-3baa-4e6f-bd00-c5dce9fd3f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:11.013179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3897a-3baa-4e6f-bd00-c5dce9fd3f2f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:11.016930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6d81-291e-429b-8ba8-0648056e8a4c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4ec3897a-3baa-4e6f-bd00-c5dce9fd3f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:11.036460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:11.037542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:11.038617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:11.038617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:11.038617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:11.038617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:11.039964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 343/677] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:11.040812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3897a-3baa-4e6f-bd00-c5dce9fd3f2f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:11.062027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9cee-fea9-4365-84f0-ba068597fd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:11.062962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9cee-fea9-4365-84f0-ba068597fd65 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.063360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9cee-fea9-4365-84f0-ba068597fd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.063644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9cee-fea9-4365-84f0-ba068597fd65 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.064641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d9cee-fea9-4365-84f0-ba068597fd65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:11.065793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d9cee-fea9-4365-84f0-ba068597fd65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:11.067400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d9cee-fea9-4365-84f0-ba068597fd65 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:11.079069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:11.089151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 335/678] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:11.089829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9cee-fea9-4365-84f0-ba068597fd65 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:11.110405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:11.159305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3897a-3baa-4e6f-bd00-c5dce9fd3f2f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:11.193940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30be205-50b1-430a-b700-a3edfd96299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:11.194691 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30be205-50b1-430a-b700-a3edfd96299c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.194984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30be205-50b1-430a-b700-a3edfd96299c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.195263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30be205-50b1-430a-b700-a3edfd96299c None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.196090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30be205-50b1-430a-b700-a3edfd96299c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:11.196399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30be205-50b1-430a-b700-a3edfd96299c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:11.197820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30be205-50b1-430a-b700-a3edfd96299c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:11.203189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9cee-fea9-4365-84f0-ba068597fd65 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:11.215309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 344/679] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:11.215309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142023-ce71-4e29-b765-647a0a215fb4 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.215309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142023-ce71-4e29-b765-647a0a215fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.215309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142023-ce71-4e29-b765-647a0a215fb4 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.215309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 345/680] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:11.215309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142023-ce71-4e29-b765-647a0a215fb4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:11.246301 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e35b3-6f01-4dd1-84c3-a739214bc845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:11.246955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e35b3-6f01-4dd1-84c3-a739214bc845 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.247243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e35b3-6f01-4dd1-84c3-a739214bc845 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.247518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e35b3-6f01-4dd1-84c3-a739214bc845 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.248282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e35b3-6f01-4dd1-84c3-a739214bc845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:11.248586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e35b3-6f01-4dd1-84c3-a739214bc845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:11.249931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e35b3-6f01-4dd1-84c3-a739214bc845 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:11.262453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 336/681] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:11.263266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e35b3-6f01-4dd1-84c3-a739214bc845 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:11.324857 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:11.333531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142023-ce71-4e29-b765-647a0a215fb4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:11.347509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:11.371919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e35b3-6f01-4dd1-84c3-a739214bc845 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:11.372268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1bcc7-e723-4eb1-b566-b0df601e3239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:11.373040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1bcc7-e723-4eb1-b566-b0df601e3239 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.373480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1bcc7-e723-4eb1-b566-b0df601e3239 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.373761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1bcc7-e723-4eb1-b566-b0df601e3239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.375328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1bcc7-e723-4eb1-b566-b0df601e3239 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=46a7d9cfbbcd4068aa9241ffd694c631) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:11.375643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1bcc7-e723-4eb1-b566-b0df601e3239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:11.377094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1bcc7-e723-4eb1-b566-b0df601e3239 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:11.396330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 346/682] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:11 2022] GET /identity/v3/role_assignments?user.id=46a7d9cfbbcd4068aa9241ffd694c631&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:11.397731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33309f-e0c5-49d3-9305-564f8204179e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.398026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33309f-e0c5-49d3-9305-564f8204179e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.398314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33309f-e0c5-49d3-9305-564f8204179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.412518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a2115-a319-47c7-ac3a-47a906f48777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:11.413628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2115-a319-47c7-ac3a-47a906f48777 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.414115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2115-a319-47c7-ac3a-47a906f48777 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.414617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2115-a319-47c7-ac3a-47a906f48777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.415688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a2115-a319-47c7-ac3a-47a906f48777 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=fb227a145fdd44319f5ccbe762409ebc) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:11.416971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a2115-a319-47c7-ac3a-47a906f48777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:11.418996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a2115-a319-47c7-ac3a-47a906f48777 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:11.422556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6c33309f-e0c5-49d3-9305-564f8204179e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:11.423810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6c33309f-e0c5-49d3-9305-564f8204179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:11.436369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 337/683] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:11 2022] GET /identity/v3/role_assignments?user.id=fb227a145fdd44319f5ccbe762409ebc&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:11.438062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a2115-a319-47c7-ac3a-47a906f48777 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:11.509783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 347/684] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:11.552713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33309f-e0c5-49d3-9305-564f8204179e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:11.587177 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a2115-a319-47c7-ac3a-47a906f48777 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:11.620990 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:11.638026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67680cd7-502d-46a0-bdb0-dac35b7b1784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:11.639156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67680cd7-502d-46a0-bdb0-dac35b7b1784 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.639600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67680cd7-502d-46a0-bdb0-dac35b7b1784 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.640052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67680cd7-502d-46a0-bdb0-dac35b7b1784 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.650910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67680cd7-502d-46a0-bdb0-dac35b7b1784 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:11.652719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67680cd7-502d-46a0-bdb0-dac35b7b1784 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-67680cd7-502d-46a0-bdb0-dac35b7b1784 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:11.669537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:11.670706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:11.671797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:11.673977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 338/685] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:11.681230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67680cd7-502d-46a0-bdb0-dac35b7b1784 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:11.720742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33309f-e0c5-49d3-9305-564f8204179e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:11.733632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:11.762330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c60be-1b91-433c-9043-25c16300592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:11.763138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c60be-1b91-433c-9043-25c16300592e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.763422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c60be-1b91-433c-9043-25c16300592e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.763700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c60be-1b91-433c-9043-25c16300592e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.774423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c60be-1b91-433c-9043-25c16300592e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-153c60be-1b91-433c-9043-25c16300592e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:11.782094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:11.783028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:11.784563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:11.785581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 348/686] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:11.789921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c60be-1b91-433c-9043-25c16300592e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:11.808501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67680cd7-502d-46a0-bdb0-dac35b7b1784 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:11.846905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d54b02-90f5-48da-8fb6-f98512aaa71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:11.847691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d54b02-90f5-48da-8fb6-f98512aaa71d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.848002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d54b02-90f5-48da-8fb6-f98512aaa71d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.848283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d54b02-90f5-48da-8fb6-f98512aaa71d None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.849262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d54b02-90f5-48da-8fb6-f98512aaa71d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:11.849575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d54b02-90f5-48da-8fb6-f98512aaa71d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:11.851012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d54b02-90f5-48da-8fb6-f98512aaa71d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:11.872289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 339/687] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 21:59:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:11.881188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d54b02-90f5-48da-8fb6-f98512aaa71d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:11.944968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c60be-1b91-433c-9043-25c16300592e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:11.962142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:11.993984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89656e5f-cf83-4bb8-a330-250eb9fe2f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:11.995013 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89656e5f-cf83-4bb8-a330-250eb9fe2f3b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:11.995949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89656e5f-cf83-4bb8-a330-250eb9fe2f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:11.996673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89656e5f-cf83-4bb8-a330-250eb9fe2f3b None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:11.997638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89656e5f-cf83-4bb8-a330-250eb9fe2f3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:11.998381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89656e5f-cf83-4bb8-a330-250eb9fe2f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:12.000441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89656e5f-cf83-4bb8-a330-250eb9fe2f3b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:12.010697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 349/688] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:12.016858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89656e5f-cf83-4bb8-a330-250eb9fe2f3b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:12.050135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d54b02-90f5-48da-8fb6-f98512aaa71d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:12.078405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:12.093531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740071c-2d3d-4c2d-b244-fcb03ea056ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:12.094195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740071c-2d3d-4c2d-b244-fcb03ea056ef None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:12.094479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740071c-2d3d-4c2d-b244-fcb03ea056ef None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:12.094754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740071c-2d3d-4c2d-b244-fcb03ea056ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:12.170193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740071c-2d3d-4c2d-b244-fcb03ea056ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:12.171872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740071c-2d3d-4c2d-b244-fcb03ea056ef None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:12.177926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89656e5f-cf83-4bb8-a330-250eb9fe2f3b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:12.214833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9be3-88a7-4d3a-9299-bc4b847d5b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:12.215640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9be3-88a7-4d3a-9299-bc4b847d5b6f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:12.215939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9be3-88a7-4d3a-9299-bc4b847d5b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:12.216230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9be3-88a7-4d3a-9299-bc4b847d5b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:12.218328 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:12.227393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b9be3-88a7-4d3a-9299-bc4b847d5b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:12.228891 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b9be3-88a7-4d3a-9299-bc4b847d5b6f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-631b9be3-88a7-4d3a-9299-bc4b847d5b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:12.253525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:12.254488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:12.255385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:12.255385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:12.255385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:12.255385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:12.255385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 350/689] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:12.264509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9be3-88a7-4d3a-9299-bc4b847d5b6f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:12.307588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 340/690] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:59:12.312639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740071c-2d3d-4c2d-b244-fcb03ea056ef None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:12.421468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740071c-2d3d-4c2d-b244-fcb03ea056ef None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:12.461077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:12.480120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b949-07eb-4e9d-8a7a-e4f02f79e4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:12.481372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b949-07eb-4e9d-8a7a-e4f02f79e4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:12.481671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b949-07eb-4e9d-8a7a-e4f02f79e4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:12.482213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b949-07eb-4e9d-8a7a-e4f02f79e4d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:12.494568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9be3-88a7-4d3a-9299-bc4b847d5b6f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:12.494949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b949-07eb-4e9d-8a7a-e4f02f79e4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:12.496600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b949-07eb-4e9d-8a7a-e4f02f79e4d0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:12.498442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-faa8b949-07eb-4e9d-8a7a-e4f02f79e4d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:12.519096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:12.520065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:12.521944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:12.521944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:12.521944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:12.521944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:12.521944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 341/691] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:12.526960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b949-07eb-4e9d-8a7a-e4f02f79e4d0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:12.566981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d92a3-7925-4478-881b-e8f57c38729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:12.567653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d92a3-7925-4478-881b-e8f57c38729a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:12.567958 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d92a3-7925-4478-881b-e8f57c38729a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:12.568237 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d92a3-7925-4478-881b-e8f57c38729a None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:12.568973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d92a3-7925-4478-881b-e8f57c38729a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:12.569281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d92a3-7925-4478-881b-e8f57c38729a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:12.570649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d92a3-7925-4478-881b-e8f57c38729a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:12.601420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 351/692] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:12.605679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d92a3-7925-4478-881b-e8f57c38729a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:12.669814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b949-07eb-4e9d-8a7a-e4f02f79e4d0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:12.705308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45083f-de25-48c0-a1c7-bb732e2fa55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:12.706409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45083f-de25-48c0-a1c7-bb732e2fa55a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:12.706786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45083f-de25-48c0-a1c7-bb732e2fa55a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:12.707775 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45083f-de25-48c0-a1c7-bb732e2fa55a None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:12.708570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45083f-de25-48c0-a1c7-bb732e2fa55a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:12.708890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45083f-de25-48c0-a1c7-bb732e2fa55a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:12.711919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45083f-de25-48c0-a1c7-bb732e2fa55a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:12.724520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 342/693] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:12.729567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45083f-de25-48c0-a1c7-bb732e2fa55a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:12.800143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d92a3-7925-4478-881b-e8f57c38729a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:12.815316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:12.838339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be151c5b-2efb-42fc-abdc-36b94448e567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:12.839135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be151c5b-2efb-42fc-abdc-36b94448e567 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:12.839421 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be151c5b-2efb-42fc-abdc-36b94448e567 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:12.839700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be151c5b-2efb-42fc-abdc-36b94448e567 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:12.847693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be151c5b-2efb-42fc-abdc-36b94448e567 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:12.849182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be151c5b-2efb-42fc-abdc-36b94448e567 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-be151c5b-2efb-42fc-abdc-36b94448e567 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:12.866688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:12.867664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 352/694] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 21:59:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0f385-8042-41ce-951b-1871a3c0bda9 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:12.872335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0f385-8042-41ce-951b-1871a3c0bda9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:12.873184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0f385-8042-41ce-951b-1871a3c0bda9 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:12.873184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 353/695] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:12.876978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0f385-8042-41ce-951b-1871a3c0bda9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:12.882436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:12.886485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45083f-de25-48c0-a1c7-bb732e2fa55a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:12.924481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5736-bb0b-4f40-b90b-bea59caad2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:12.925289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5736-bb0b-4f40-b90b-bea59caad2bf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:12.925580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5736-bb0b-4f40-b90b-bea59caad2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:12.925859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5736-bb0b-4f40-b90b-bea59caad2bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:12.933277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5736-bb0b-4f40-b90b-bea59caad2bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:12.934720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5736-bb0b-4f40-b90b-bea59caad2bf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-ed6e5736-bb0b-4f40-b90b-bea59caad2bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:12.949243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:12.950167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:12.951616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:12.951616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:12.951616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:12.951616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:12.951616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:12.951616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:12.951616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:12.951616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:12.951616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 343/696] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:12.952120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360b211-ffe1-487a-adfe-bd96b23a5aaa None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:12.952371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360b211-ffe1-487a-adfe-bd96b23a5aaa None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:12.952591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360b211-ffe1-487a-adfe-bd96b23a5aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:12.977543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a360b211-ffe1-487a-adfe-bd96b23a5aaa None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:12.979302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a360b211-ffe1-487a-adfe-bd96b23a5aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:13.003762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0f385-8042-41ce-951b-1871a3c0bda9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:13.041332 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b972b8-ee96-47f0-9abc-19a90eb7c77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:13.042417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b972b8-ee96-47f0-9abc-19a90eb7c77b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.042950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b972b8-ee96-47f0-9abc-19a90eb7c77b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.043606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b972b8-ee96-47f0-9abc-19a90eb7c77b None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.044702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b972b8-ee96-47f0-9abc-19a90eb7c77b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:13.045246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b972b8-ee96-47f0-9abc-19a90eb7c77b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:13.047187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b972b8-ee96-47f0-9abc-19a90eb7c77b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:13.071825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 344/697] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:13.071825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360b211-ffe1-487a-adfe-bd96b23a5aaa None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:13.073019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 354/698] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 21:59:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:13.078898 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b972b8-ee96-47f0-9abc-19a90eb7c77b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:13.117470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:13.164619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:13.186215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360b211-ffe1-487a-adfe-bd96b23a5aaa None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:13.217201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b972b8-ee96-47f0-9abc-19a90eb7c77b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:13.226406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f0fc4-2eae-4dc3-950e-3f337e731e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:13.227342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f0fc4-2eae-4dc3-950e-3f337e731e5f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.228019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f0fc4-2eae-4dc3-950e-3f337e731e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.228499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f0fc4-2eae-4dc3-950e-3f337e731e5f None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.229600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f0fc4-2eae-4dc3-950e-3f337e731e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:13.230115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f0fc4-2eae-4dc3-950e-3f337e731e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:13.231880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f0fc4-2eae-4dc3-950e-3f337e731e5f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:13.245764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 345/699] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:13.247352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f0fc4-2eae-4dc3-950e-3f337e731e5f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:13.255835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf6a25-1c17-4814-b5e7-819d92ad4584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:13.256475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf6a25-1c17-4814-b5e7-819d92ad4584 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.256764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf6a25-1c17-4814-b5e7-819d92ad4584 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.259820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf6a25-1c17-4814-b5e7-819d92ad4584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.331100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf6a25-1c17-4814-b5e7-819d92ad4584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:13.333824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf6a25-1c17-4814-b5e7-819d92ad4584 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:13.364267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f0fc4-2eae-4dc3-950e-3f337e731e5f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:13.366833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:13.406505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:13.412403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b2b5d-448c-4196-966c-481d994314f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:13.413483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b2b5d-448c-4196-966c-481d994314f5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.414020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b2b5d-448c-4196-966c-481d994314f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.414727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b2b5d-448c-4196-966c-481d994314f5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.416220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b2b5d-448c-4196-966c-481d994314f5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:13.417606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b2b5d-448c-4196-966c-481d994314f5 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c51b2b5d-448c-4196-966c-481d994314f5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:13.434349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:13.435354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:13.436223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 346/700] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jul 13 21:59:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:13.437150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b2b5d-448c-4196-966c-481d994314f5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:13.464257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 355/701] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 21:59:13.466281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf6a25-1c17-4814-b5e7-819d92ad4584 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:13.558420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b2b5d-448c-4196-966c-481d994314f5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:13.583244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf6a25-1c17-4814-b5e7-819d92ad4584 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:13.608716 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10873-2dc1-4ca9-a257-4c704d6b7f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:13.610266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10873-2dc1-4ca9-a257-4c704d6b7f07 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.610713 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10873-2dc1-4ca9-a257-4c704d6b7f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.611146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10873-2dc1-4ca9-a257-4c704d6b7f07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.613655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f10873-2dc1-4ca9-a257-4c704d6b7f07 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=2695a36b9b38450981588c31c2b9afc7) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:13.614411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f10873-2dc1-4ca9-a257-4c704d6b7f07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:13.616702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f10873-2dc1-4ca9-a257-4c704d6b7f07 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:13.621653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b492cde-5398-46b0-9dda-db31d12d544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:13.622432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b492cde-5398-46b0-9dda-db31d12d544b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.622819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b492cde-5398-46b0-9dda-db31d12d544b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.623266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b492cde-5398-46b0-9dda-db31d12d544b None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.624124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b492cde-5398-46b0-9dda-db31d12d544b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:13.624564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b492cde-5398-46b0-9dda-db31d12d544b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:13.632148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b492cde-5398-46b0-9dda-db31d12d544b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:13.632343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 347/702] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:13 2022] GET /identity/v3/role_assignments?user.id=2695a36b9b38450981588c31c2b9afc7&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:13.632343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10873-2dc1-4ca9-a257-4c704d6b7f07 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:13.639995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 356/703] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 21:59:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:13.645968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b492cde-5398-46b0-9dda-db31d12d544b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:13.694561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:13.703037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:13.839759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b492cde-5398-46b0-9dda-db31d12d544b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:13.842024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10873-2dc1-4ca9-a257-4c704d6b7f07 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:13.878006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80164-25c3-4037-9234-ddc2326bfe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:13.879198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80164-25c3-4037-9234-ddc2326bfe49 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.879413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80164-25c3-4037-9234-ddc2326bfe49 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.879674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80164-25c3-4037-9234-ddc2326bfe49 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.881192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def80164-25c3-4037-9234-ddc2326bfe49 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:13.881508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def80164-25c3-4037-9234-ddc2326bfe49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:13.882931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def80164-25c3-4037-9234-ddc2326bfe49 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:13.887237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647a67d-1268-4b79-ad48-30e553d36e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:13.888333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647a67d-1268-4b79-ad48-30e553d36e93 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.888818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647a67d-1268-4b79-ad48-30e553d36e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.889307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647a67d-1268-4b79-ad48-30e553d36e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.889597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 357/704] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 21:59:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:13.901436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647a67d-1268-4b79-ad48-30e553d36e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:13.903139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647a67d-1268-4b79-ad48-30e553d36e93 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c647a67d-1268-4b79-ad48-30e553d36e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:13.923009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:13.924011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:13.925630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:13.925630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:13.925630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:13.925630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:13.925630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 348/705] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:13.930574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80164-25c3-4037-9234-ddc2326bfe49 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:13.934143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41a563-a778-4e43-9c98-77b17f94263f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.934436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41a563-a778-4e43-9c98-77b17f94263f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.934714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41a563-a778-4e43-9c98-77b17f94263f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.937697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 349/706] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:13.943210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c023cb-83ff-4a9f-bb77-ece26b63983e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:13.943590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c023cb-83ff-4a9f-bb77-ece26b63983e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:13.943984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c023cb-83ff-4a9f-bb77-ece26b63983e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:13.963503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-47c023cb-83ff-4a9f-bb77-ece26b63983e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:13.965068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-47c023cb-83ff-4a9f-bb77-ece26b63983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:14.065953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 350/707] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:59:14.067529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:14.073533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3ba1-0a76-477a-9738-a03368b6c40f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.073825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3ba1-0a76-477a-9738-a03368b6c40f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.074158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3ba1-0a76-477a-9738-a03368b6c40f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.076836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 351/708] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:14.083278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af317866-e00a-40cb-9f7f-453cae9e093f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.083554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af317866-e00a-40cb-9f7f-453cae9e093f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.084360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af317866-e00a-40cb-9f7f-453cae9e093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.095444 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80164-25c3-4037-9234-ddc2326bfe49 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:14.113147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-af317866-e00a-40cb-9f7f-453cae9e093f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:14.113594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-af317866-e00a-40cb-9f7f-453cae9e093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:14.134111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:14.144676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373d1b0-1290-44e0-b227-fa319f3cef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:14.145357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d1b0-1290-44e0-b227-fa319f3cef5c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.145651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d1b0-1290-44e0-b227-fa319f3cef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.145984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d1b0-1290-44e0-b227-fa319f3cef5c None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.146726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373d1b0-1290-44e0-b227-fa319f3cef5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:14.147039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373d1b0-1290-44e0-b227-fa319f3cef5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:14.148448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373d1b0-1290-44e0-b227-fa319f3cef5c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:14.162084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 358/709] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:14.163111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373d1b0-1290-44e0-b227-fa319f3cef5c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:14.208387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 352/710] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:14.209704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af317866-e00a-40cb-9f7f-453cae9e093f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:14.282954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373d1b0-1290-44e0-b227-fa319f3cef5c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:14.330134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af317866-e00a-40cb-9f7f-453cae9e093f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:14.331141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745eb82-8694-4589-b020-352489988869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:14.332629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745eb82-8694-4589-b020-352489988869 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.332922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745eb82-8694-4589-b020-352489988869 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.334097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745eb82-8694-4589-b020-352489988869 None admin] PATH_INFO: `/v3/services/network` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.334787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745eb82-8694-4589-b020-352489988869 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:14.336241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745eb82-8694-4589-b020-352489988869 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-8745eb82-8694-4589-b020-352489988869 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:14.354626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:14.355614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 21:59:14.356462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:14.360311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 359/711] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:14 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:14.360826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745eb82-8694-4589-b020-352489988869 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:14.379053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ca5d2-8cda-43db-8edd-04928a9cf9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:14.380170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ca5d2-8cda-43db-8edd-04928a9cf9bd None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.380461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ca5d2-8cda-43db-8edd-04928a9cf9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.380742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ca5d2-8cda-43db-8edd-04928a9cf9bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.381538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:14.392237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ca5d2-8cda-43db-8edd-04928a9cf9bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:14.395021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ca5d2-8cda-43db-8edd-04928a9cf9bd None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-ce3ca5d2-8cda-43db-8edd-04928a9cf9bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:14.414653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:14.416642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 353/712] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:14.418118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ca5d2-8cda-43db-8edd-04928a9cf9bd None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:14.423536 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:14.477358 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745eb82-8694-4589-b020-352489988869 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:14.515333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2b551-b559-489f-9ba9-1132584f71fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:14.516268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2b551-b559-489f-9ba9-1132584f71fd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.516622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2b551-b559-489f-9ba9-1132584f71fd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.516973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2b551-b559-489f-9ba9-1132584f71fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.528621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2b551-b559-489f-9ba9-1132584f71fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:14.530201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2b551-b559-489f-9ba9-1132584f71fd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b4b2b551-b559-489f-9ba9-1132584f71fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:14.549324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:14.551134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:14.553230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:14.553230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:14.553230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:14.553230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:14.553759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ca5d2-8cda-43db-8edd-04928a9cf9bd None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:14.553903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 360/713] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:14.553903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2b551-b559-489f-9ba9-1132584f71fd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:14.590011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5d83a-93d2-4c87-8b96-f5b1a2afa5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:14.590686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5d83a-93d2-4c87-8b96-f5b1a2afa5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.590969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5d83a-93d2-4c87-8b96-f5b1a2afa5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.591977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5d83a-93d2-4c87-8b96-f5b1a2afa5d0 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.591977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5d83a-93d2-4c87-8b96-f5b1a2afa5d0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:14.592279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5d83a-93d2-4c87-8b96-f5b1a2afa5d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:14.593669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5d83a-93d2-4c87-8b96-f5b1a2afa5d0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:14.603941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 354/714] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:14.604939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5d83a-93d2-4c87-8b96-f5b1a2afa5d0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:14.619248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:14.660288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2b551-b559-489f-9ba9-1132584f71fd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:14.678882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:14.696509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d019e-1ea2-4b2e-a84c-06a965bd2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:14.697272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d019e-1ea2-4b2e-a84c-06a965bd2405 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.697630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d019e-1ea2-4b2e-a84c-06a965bd2405 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.697983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d019e-1ea2-4b2e-a84c-06a965bd2405 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.698917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d019e-1ea2-4b2e-a84c-06a965bd2405 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:14.699376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d019e-1ea2-4b2e-a84c-06a965bd2405 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:14.700913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d019e-1ea2-4b2e-a84c-06a965bd2405 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:14.714744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 361/715] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:14.715652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d019e-1ea2-4b2e-a84c-06a965bd2405 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:14.720178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5d83a-93d2-4c87-8b96-f5b1a2afa5d0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:14.758675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c93b7-5134-4105-82c0-d72da9f03b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:14.759655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c93b7-5134-4105-82c0-d72da9f03b18 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.760176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c93b7-5134-4105-82c0-d72da9f03b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.760677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c93b7-5134-4105-82c0-d72da9f03b18 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.761632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c93b7-5134-4105-82c0-d72da9f03b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:14.762138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c93b7-5134-4105-82c0-d72da9f03b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:14.763731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c93b7-5134-4105-82c0-d72da9f03b18 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:14.777252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 355/716] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:14.778622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c93b7-5134-4105-82c0-d72da9f03b18 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:14.822223 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d019e-1ea2-4b2e-a84c-06a965bd2405 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:14.846245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:14.857171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd772659-e2da-4266-8ca1-5af398c07259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:14.857943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd772659-e2da-4266-8ca1-5af398c07259 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.858588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd772659-e2da-4266-8ca1-5af398c07259 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.859184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd772659-e2da-4266-8ca1-5af398c07259 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.860297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd772659-e2da-4266-8ca1-5af398c07259 None admin] RBAC: Adding query filter params (type=network) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:14.860708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd772659-e2da-4266-8ca1-5af398c07259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:14.862842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd772659-e2da-4266-8ca1-5af398c07259 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:14.875928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 362/717] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:14.875928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd772659-e2da-4266-8ca1-5af398c07259 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:14.910442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c93b7-5134-4105-82c0-d72da9f03b18 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:14.954675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:14.976402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9536ede-17d0-48d2-9e8e-40e1884e3010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:14.977593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9536ede-17d0-48d2-9e8e-40e1884e3010 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:14.978092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9536ede-17d0-48d2-9e8e-40e1884e3010 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:14.978623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9536ede-17d0-48d2-9e8e-40e1884e3010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:14.979694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9536ede-17d0-48d2-9e8e-40e1884e3010 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=44e6d786ac4a40468794b18cfedfa730) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:14.980375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9536ede-17d0-48d2-9e8e-40e1884e3010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:14.983600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9536ede-17d0-48d2-9e8e-40e1884e3010 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:14.998674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 356/718] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:14 2022] GET /identity/v3/role_assignments?user.id=44e6d786ac4a40468794b18cfedfa730&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:15.011233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd772659-e2da-4266-8ca1-5af398c07259 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:15.058361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a689b-47f2-40c4-a6a2-370f27555ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:15.059483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a689b-47f2-40c4-a6a2-370f27555ece None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:15.060058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a689b-47f2-40c4-a6a2-370f27555ece None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:15.060542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a689b-47f2-40c4-a6a2-370f27555ece None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:15.061472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a689b-47f2-40c4-a6a2-370f27555ece None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:15.063221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a689b-47f2-40c4-a6a2-370f27555ece None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:15.100371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 363/719] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:59:14 2022] POST /identity/v3/users => generated 254 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:16.086483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34e79-9c5e-45ff-8d63-283067972bf6 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:16.087011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34e79-9c5e-45ff-8d63-283067972bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:16.087011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34e79-9c5e-45ff-8d63-283067972bf6 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:16.088682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 357/720] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:16.094073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184d25d-7c47-46af-a147-055a960360c4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:16.094495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184d25d-7c47-46af-a147-055a960360c4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:16.094663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184d25d-7c47-46af-a147-055a960360c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:16.112555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1184d25d-7c47-46af-a147-055a960360c4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:16.113753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1184d25d-7c47-46af-a147-055a960360c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:16.156521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:16.173211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38991b83-22d4-475b-85f7-737e91c0a381 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:16.173497 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38991b83-22d4-475b-85f7-737e91c0a381 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:16.173784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38991b83-22d4-475b-85f7-737e91c0a381 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:16.175539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 358/721] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:16.181885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd99aa-e2f2-4977-9e1d-6e83f84c2753 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:16.182283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd99aa-e2f2-4977-9e1d-6e83f84c2753 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:16.182667 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd99aa-e2f2-4977-9e1d-6e83f84c2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:16.207480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 364/722] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:16.212786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a0bd99aa-e2f2-4977-9e1d-6e83f84c2753 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:16.214135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a0bd99aa-e2f2-4977-9e1d-6e83f84c2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:16.275404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184d25d-7c47-46af-a147-055a960360c4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:16.333030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 359/723] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 21:59:16.369572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd99aa-e2f2-4977-9e1d-6e83f84c2753 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:16.424730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184d25d-7c47-46af-a147-055a960360c4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:16.491955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979c6de-c0c4-4641-b7f9-0a0d2cc98a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:16.492788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979c6de-c0c4-4641-b7f9-0a0d2cc98a92 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:16.493235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979c6de-c0c4-4641-b7f9-0a0d2cc98a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:16.493532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979c6de-c0c4-4641-b7f9-0a0d2cc98a92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:16.514747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979c6de-c0c4-4641-b7f9-0a0d2cc98a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e979c6de-c0c4-4641-b7f9-0a0d2cc98a92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:16.523396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:16.524359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:16.525183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:16.526036 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 365/724] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:16.536060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979c6de-c0c4-4641-b7f9-0a0d2cc98a92 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:16.551746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd99aa-e2f2-4977-9e1d-6e83f84c2753 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:16.587887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:16.608083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa898-8572-405a-9e63-f14aac96c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:16.608966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:16.609703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa898-8572-405a-9e63-f14aac96c6cc None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:16.609995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa898-8572-405a-9e63-f14aac96c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:16.610277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa898-8572-405a-9e63-f14aac96c6cc None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:16.611006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aa898-8572-405a-9e63-f14aac96c6cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:16.613045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aa898-8572-405a-9e63-f14aac96c6cc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:16.643647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 360/725] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:59:16 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 21:59:16.709651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979c6de-c0c4-4641-b7f9-0a0d2cc98a92 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:16.753412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5106ec-ec37-4c33-bd6c-e11332b56463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:16.754099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5106ec-ec37-4c33-bd6c-e11332b56463 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:16.754386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5106ec-ec37-4c33-bd6c-e11332b56463 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:16.754666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5106ec-ec37-4c33-bd6c-e11332b56463 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:16.755492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5106ec-ec37-4c33-bd6c-e11332b56463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:16.755804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5106ec-ec37-4c33-bd6c-e11332b56463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:16.757347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5106ec-ec37-4c33-bd6c-e11332b56463 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:16.767294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 366/726] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:16.773539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa898-8572-405a-9e63-f14aac96c6cc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:16.929229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa898-8572-405a-9e63-f14aac96c6cc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:16.975351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac452b00-27f1-4353-bca9-dff70646044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:16.976185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac452b00-27f1-4353-bca9-dff70646044e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:16.976472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac452b00-27f1-4353-bca9-dff70646044e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:16.976753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac452b00-27f1-4353-bca9-dff70646044e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:16.991104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac452b00-27f1-4353-bca9-dff70646044e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:16.992598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac452b00-27f1-4353-bca9-dff70646044e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-ac452b00-27f1-4353-bca9-dff70646044e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:17.021033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:17.021975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:17.023285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:17.023285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:17.023285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:17.023285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:17.023285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 361/727] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:17.029424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5106ec-ec37-4c33-bd6c-e11332b56463 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:17.146739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:17.160456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5106ec-ec37-4c33-bd6c-e11332b56463 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:17.197073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84d56e-ddbc-4bfa-948b-c4fca1735ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:17.197712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d56e-ddbc-4bfa-948b-c4fca1735ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:17.197994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d56e-ddbc-4bfa-948b-c4fca1735ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:17.198269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d56e-ddbc-4bfa-948b-c4fca1735ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:17.199029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d56e-ddbc-4bfa-948b-c4fca1735ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:17.199336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d56e-ddbc-4bfa-948b-c4fca1735ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:17.200720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d56e-ddbc-4bfa-948b-c4fca1735ca0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:17.216483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 367/728] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:17.219801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac452b00-27f1-4353-bca9-dff70646044e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:17.268199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:17.357058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac452b00-27f1-4353-bca9-dff70646044e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:17.412857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075d39c-c499-4912-8959-2394e96bc94c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:17.413176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075d39c-c499-4912-8959-2394e96bc94c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:17.413423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075d39c-c499-4912-8959-2394e96bc94c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:17.417709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 368/729] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:17.421149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8075e55-d116-49ab-8a88-1d591d93ef12 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:17.421438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8075e55-d116-49ab-8a88-1d591d93ef12 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:17.421720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8075e55-d116-49ab-8a88-1d591d93ef12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:17.456885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e8075e55-d116-49ab-8a88-1d591d93ef12 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:17.458278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e8075e55-d116-49ab-8a88-1d591d93ef12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:17.543033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751037-0e33-4722-b74b-2e12c645ff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:17.543880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751037-0e33-4722-b74b-2e12c645ff0d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:17.544191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751037-0e33-4722-b74b-2e12c645ff0d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:17.544463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751037-0e33-4722-b74b-2e12c645ff0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:17.560442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d751037-0e33-4722-b74b-2e12c645ff0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:17.561964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d751037-0e33-4722-b74b-2e12c645ff0d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8d751037-0e33-4722-b74b-2e12c645ff0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:17.589688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:17.592147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:17.594329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:17.595543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 369/731] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:17.595691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 362/731] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:17.595871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad24c33-29a3-4854-a689-5cf9fdfd328f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:17.595871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad24c33-29a3-4854-a689-5cf9fdfd328f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:17.602348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad24c33-29a3-4854-a689-5cf9fdfd328f None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:17.602424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751037-0e33-4722-b74b-2e12c645ff0d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:17.602511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 370/732] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:17.604064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdfa6a-d448-473c-9893-e41699c759b3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:17.604567 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdfa6a-d448-473c-9893-e41699c759b3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:17.605048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdfa6a-d448-473c-9893-e41699c759b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:17.634131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-25fdfa6a-d448-473c-9893-e41699c759b3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:17.635505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-25fdfa6a-d448-473c-9893-e41699c759b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:17.702203 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:17.711500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751037-0e33-4722-b74b-2e12c645ff0d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:17.735918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 371/733] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 21:59:17.735918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdfa6a-d448-473c-9893-e41699c759b3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:17.746825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:17.772566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867afb2-9ae0-4e09-a052-97b15ecd8c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:17.773638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867afb2-9ae0-4e09-a052-97b15ecd8c53 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:17.774165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867afb2-9ae0-4e09-a052-97b15ecd8c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:17.774640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867afb2-9ae0-4e09-a052-97b15ecd8c53 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:17.775728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867afb2-9ae0-4e09-a052-97b15ecd8c53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:17.776281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867afb2-9ae0-4e09-a052-97b15ecd8c53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:17.777973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867afb2-9ae0-4e09-a052-97b15ecd8c53 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:17.797589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 363/734] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 21:59:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:17.798737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867afb2-9ae0-4e09-a052-97b15ecd8c53 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:17.858456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdfa6a-d448-473c-9893-e41699c759b3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:17.898479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898c1eb-f4f2-47ee-baa5-31e4ad4ab6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:17.899589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898c1eb-f4f2-47ee-baa5-31e4ad4ab6e4 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:17.900105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898c1eb-f4f2-47ee-baa5-31e4ad4ab6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:17.900609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898c1eb-f4f2-47ee-baa5-31e4ad4ab6e4 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:17.901642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898c1eb-f4f2-47ee-baa5-31e4ad4ab6e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:17.903233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898c1eb-f4f2-47ee-baa5-31e4ad4ab6e4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:17.924519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 372/735] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:59:17 2022] POST /identity/v3/services => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:17.925692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898c1eb-f4f2-47ee-baa5-31e4ad4ab6e4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:17.943142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867afb2-9ae0-4e09-a052-97b15ecd8c53 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:18.014908 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884182f-892d-4173-ac25-7c1f1229982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:18.016027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884182f-892d-4173-ac25-7c1f1229982e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.016321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884182f-892d-4173-ac25-7c1f1229982e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.016601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884182f-892d-4173-ac25-7c1f1229982e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.019387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:18.036693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884182f-892d-4173-ac25-7c1f1229982e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c884182f-892d-4173-ac25-7c1f1229982e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:18.046929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:18.048125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:18.049797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:18.053063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 364/736] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:18.054790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fbbc5-f091-4597-ae2e-5de39c8695c5 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.055216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fbbc5-f091-4597-ae2e-5de39c8695c5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.055620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fbbc5-f091-4597-ae2e-5de39c8695c5 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.057699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 365/737] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:18.058763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fbbc5-f091-4597-ae2e-5de39c8695c5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:18.064425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898c1eb-f4f2-47ee-baa5-31e4ad4ab6e4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:18.073672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:18.114046 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459956d-9282-4a34-890c-3d85a520087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:18.115062 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459956d-9282-4a34-890c-3d85a520087a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.115554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459956d-9282-4a34-890c-3d85a520087a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.116108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459956d-9282-4a34-890c-3d85a520087a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.194645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fbbc5-f091-4597-ae2e-5de39c8695c5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:18.201045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459956d-9282-4a34-890c-3d85a520087a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:18.202718 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459956d-9282-4a34-890c-3d85a520087a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:18.243663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b65aa-1967-46ca-8d74-5fd7e2b0dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:18.245555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b65aa-1967-46ca-8d74-5fd7e2b0dab6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.246494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b65aa-1967-46ca-8d74-5fd7e2b0dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.246997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b65aa-1967-46ca-8d74-5fd7e2b0dab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.248541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b65aa-1967-46ca-8d74-5fd7e2b0dab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:18.249167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b65aa-1967-46ca-8d74-5fd7e2b0dab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:18.251053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b65aa-1967-46ca-8d74-5fd7e2b0dab6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:18.264055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 366/738] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:18.265923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7ff8-9fb2-47d4-a8b5-316a48ca9c62 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.266438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7ff8-9fb2-47d4-a8b5-316a48ca9c62 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.266922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7ff8-9fb2-47d4-a8b5-316a48ca9c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.283819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:18.287340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-38ce7ff8-9fb2-47d4-a8b5-316a48ca9c62 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:18.288850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-38ce7ff8-9fb2-47d4-a8b5-316a48ca9c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:18.317946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 373/739] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 21:59:18.319015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459956d-9282-4a34-890c-3d85a520087a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:18.360814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:18.376043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 367/740] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:18.377926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7ff8-9fb2-47d4-a8b5-316a48ca9c62 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:18.437262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459956d-9282-4a34-890c-3d85a520087a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:18.473315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051032b-1a70-4947-a5dd-434a29c6a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:18.474111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051032b-1a70-4947-a5dd-434a29c6a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.474393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051032b-1a70-4947-a5dd-434a29c6a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.474668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051032b-1a70-4947-a5dd-434a29c6a4a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.485064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051032b-1a70-4947-a5dd-434a29c6a4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:18.486768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051032b-1a70-4947-a5dd-434a29c6a4a1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:18.489815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7ff8-9fb2-47d4-a8b5-316a48ca9c62 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:18.529072 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89f646-84ef-42c1-b3cc-60c211a52144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:18.530279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89f646-84ef-42c1-b3cc-60c211a52144 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.530790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89f646-84ef-42c1-b3cc-60c211a52144 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.531268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89f646-84ef-42c1-b3cc-60c211a52144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.544069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89f646-84ef-42c1-b3cc-60c211a52144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:18.545919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89f646-84ef-42c1-b3cc-60c211a52144 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-bc89f646-84ef-42c1-b3cc-60c211a52144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:18.569906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:18.570873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:18.571774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:18.571774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:18.571774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:18.571774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:18.588252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 368/741] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:18.588252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89f646-84ef-42c1-b3cc-60c211a52144 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1051032b-1a70-4947-a5dd-434a29c6a4a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:18.630884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:18.631985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:18.632945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:18.632945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:18.632945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:18.632945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:18.636051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 374/742] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:18.637425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051032b-1a70-4947-a5dd-434a29c6a4a1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:18.648945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:18.676400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:18.703558 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89f646-84ef-42c1-b3cc-60c211a52144 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:18.740549 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9d5f-40c7-4a67-adc9-3113c48e334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:18.741644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9d5f-40c7-4a67-adc9-3113c48e334e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.741644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9d5f-40c7-4a67-adc9-3113c48e334e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.741919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9d5f-40c7-4a67-adc9-3113c48e334e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.755162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9d5f-40c7-4a67-adc9-3113c48e334e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c14e9d5f-40c7-4a67-adc9-3113c48e334e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:18.765681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:18.766636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:18.767466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:18.775963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 369/743] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:18.775963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9d5f-40c7-4a67-adc9-3113c48e334e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:18.786514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051032b-1a70-4947-a5dd-434a29c6a4a1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:18.829165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b8544-a910-43fb-bcb1-0da187cecfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:18.829812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b8544-a910-43fb-bcb1-0da187cecfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.830633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b8544-a910-43fb-bcb1-0da187cecfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.830913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b8544-a910-43fb-bcb1-0da187cecfb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.831702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b8544-a910-43fb-bcb1-0da187cecfb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:18.832478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b8544-a910-43fb-bcb1-0da187cecfb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:18.833717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b8544-a910-43fb-bcb1-0da187cecfb2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:18.850394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 375/744] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:18.851443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b8544-a910-43fb-bcb1-0da187cecfb2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:18.902652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9d5f-40c7-4a67-adc9-3113c48e334e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:18.920743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:18.946364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd3109-d0d5-444a-a754-e28b214fbdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:18.947058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd3109-d0d5-444a-a754-e28b214fbdbc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:18.947342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd3109-d0d5-444a-a754-e28b214fbdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:18.947637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd3109-d0d5-444a-a754-e28b214fbdbc None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:18.948506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd3109-d0d5-444a-a754-e28b214fbdbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:18.948815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd3109-d0d5-444a-a754-e28b214fbdbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:18.950264 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd3109-d0d5-444a-a754-e28b214fbdbc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:18.952257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:18.968973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 370/745] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:18.968973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd3109-d0d5-444a-a754-e28b214fbdbc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:18.977566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b8544-a910-43fb-bcb1-0da187cecfb2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.013322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fb141-0e3a-485b-8a34-b4e1c2cfb8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.014060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fb141-0e3a-485b-8a34-b4e1c2cfb8df None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.014937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fb141-0e3a-485b-8a34-b4e1c2cfb8df None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.014937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fb141-0e3a-485b-8a34-b4e1c2cfb8df None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.015404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fb141-0e3a-485b-8a34-b4e1c2cfb8df None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:19.015720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fb141-0e3a-485b-8a34-b4e1c2cfb8df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.017111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fb141-0e3a-485b-8a34-b4e1c2cfb8df None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.025934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 376/746] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:19.026716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fb141-0e3a-485b-8a34-b4e1c2cfb8df None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.096585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd3109-d0d5-444a-a754-e28b214fbdbc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.137674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85557-60e6-4461-b8c4-6eda049f781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.138518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85557-60e6-4461-b8c4-6eda049f781e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.138899 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85557-60e6-4461-b8c4-6eda049f781e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.139180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85557-60e6-4461-b8c4-6eda049f781e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.147364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff85557-60e6-4461-b8c4-6eda049f781e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.148969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff85557-60e6-4461-b8c4-6eda049f781e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.162703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fb141-0e3a-485b-8a34-b4e1c2cfb8df None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-dff85557-60e6-4461-b8c4-6eda049f781e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:19.164663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:19.165535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:19.166535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:19.166535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:19.166535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:19.166535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:19.166535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:19.166535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:19.166535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:19.166535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:19.166535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 371/747] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:19.167522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85557-60e6-4461-b8c4-6eda049f781e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.202398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:19.213308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a234e-36ad-4f73-b8c7-e22acad3fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.215214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a234e-36ad-4f73-b8c7-e22acad3fc96 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.215729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a234e-36ad-4f73-b8c7-e22acad3fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.216478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a234e-36ad-4f73-b8c7-e22acad3fc96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.225948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a234e-36ad-4f73-b8c7-e22acad3fc96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.227401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a234e-36ad-4f73-b8c7-e22acad3fc96 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9b0a234e-36ad-4f73-b8c7-e22acad3fc96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:19.241970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:19.242934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:19.243862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 377/748] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:19.244475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a234e-36ad-4f73-b8c7-e22acad3fc96 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.253854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:19.283819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85557-60e6-4461-b8c4-6eda049f781e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.317526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf614-8638-4a7b-8b13-8e3fb63e5ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.318322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf614-8638-4a7b-8b13-8e3fb63e5ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.318629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf614-8638-4a7b-8b13-8e3fb63e5ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.318905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf614-8638-4a7b-8b13-8e3fb63e5ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.329183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf614-8638-4a7b-8b13-8e3fb63e5ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.331171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf614-8638-4a7b-8b13-8e3fb63e5ef7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e79cf614-8638-4a7b-8b13-8e3fb63e5ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:19.348100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:19.349110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:19.350058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:19.350058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:19.350058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:19.350058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:19.350058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 372/749] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:19.350459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e5dde-2377-451a-a3b5-2445a5222ed9 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.350749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e5dde-2377-451a-a3b5-2445a5222ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.351023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e5dde-2377-451a-a3b5-2445a5222ed9 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.355931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 373/750] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:19.355931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e5dde-2377-451a-a3b5-2445a5222ed9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.358950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a234e-36ad-4f73-b8c7-e22acad3fc96 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.395731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c82d20-26b6-49dc-80a0-27b455f9e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.396414 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c82d20-26b6-49dc-80a0-27b455f9e1dc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.396798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c82d20-26b6-49dc-80a0-27b455f9e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.397098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c82d20-26b6-49dc-80a0-27b455f9e1dc None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.397891 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c82d20-26b6-49dc-80a0-27b455f9e1dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:19.398200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c82d20-26b6-49dc-80a0-27b455f9e1dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.399731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c82d20-26b6-49dc-80a0-27b455f9e1dc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.412666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 378/751] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:19.413449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c82d20-26b6-49dc-80a0-27b455f9e1dc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.444969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:19.466614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e5dde-2377-451a-a3b5-2445a5222ed9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.491989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:19.501592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75539bc9-8578-492a-9c1c-612d25d359ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.502861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75539bc9-8578-492a-9c1c-612d25d359ad None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.503143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75539bc9-8578-492a-9c1c-612d25d359ad None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.503415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75539bc9-8578-492a-9c1c-612d25d359ad None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.504284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75539bc9-8578-492a-9c1c-612d25d359ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:19.504592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75539bc9-8578-492a-9c1c-612d25d359ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.506118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75539bc9-8578-492a-9c1c-612d25d359ad None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.528295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 374/752] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:19.529623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db31f-d128-446c-a712-c4bfb86f79f6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.529917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db31f-d128-446c-a712-c4bfb86f79f6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.530198 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db31f-d128-446c-a712-c4bfb86f79f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.534261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c82d20-26b6-49dc-80a0-27b455f9e1dc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.546404 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-784db31f-d128-446c-a712-c4bfb86f79f6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:19.547574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-784db31f-d128-446c-a712-c4bfb86f79f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:19.571451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25e94e-417d-46ea-8fe4-c0dfc08b5744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.572151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25e94e-417d-46ea-8fe4-c0dfc08b5744 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.572439 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25e94e-417d-46ea-8fe4-c0dfc08b5744 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.572716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25e94e-417d-46ea-8fe4-c0dfc08b5744 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.573443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25e94e-417d-46ea-8fe4-c0dfc08b5744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:19.573750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25e94e-417d-46ea-8fe4-c0dfc08b5744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.575103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25e94e-417d-46ea-8fe4-c0dfc08b5744 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.587869 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 379/753] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:19.588710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25e94e-417d-46ea-8fe4-c0dfc08b5744 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.636122 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 375/754] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:19.637349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db31f-d128-446c-a712-c4bfb86f79f6 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.698244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25e94e-417d-46ea-8fe4-c0dfc08b5744 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.721401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:19.725417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:19.736214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037a11-9851-43d2-a0c2-5961e4930d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.737657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037a11-9851-43d2-a0c2-5961e4930d06 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.738037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037a11-9851-43d2-a0c2-5961e4930d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.738316 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037a11-9851-43d2-a0c2-5961e4930d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.739152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037a11-9851-43d2-a0c2-5961e4930d06 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=2695a36b9b38450981588c31c2b9afc7) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:19.739464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037a11-9851-43d2-a0c2-5961e4930d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.741031 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037a11-9851-43d2-a0c2-5961e4930d06 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.746878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 380/755] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/role_assignments?user.id=2695a36b9b38450981588c31c2b9afc7&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:19.747650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037a11-9851-43d2-a0c2-5961e4930d06 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.767014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db31f-d128-446c-a712-c4bfb86f79f6 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.811715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdf924-9d39-4da5-86a4-c2a486891be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.812970 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdf924-9d39-4da5-86a4-c2a486891be4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.813460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdf924-9d39-4da5-86a4-c2a486891be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.814013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdf924-9d39-4da5-86a4-c2a486891be4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.826496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdf924-9d39-4da5-86a4-c2a486891be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.828603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdf924-9d39-4da5-86a4-c2a486891be4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-7bbdf924-9d39-4da5-86a4-c2a486891be4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:19.850117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:19.851070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:19.851986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:19.851986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:19.851986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:19.851986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:19.854488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 376/756] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:19.855552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdf924-9d39-4da5-86a4-c2a486891be4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.870808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037a11-9851-43d2-a0c2-5961e4930d06 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.909226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9458aa-36da-469c-ad55-4639dc68492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:19.909983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9458aa-36da-469c-ad55-4639dc68492b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:19.910272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9458aa-36da-469c-ad55-4639dc68492b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:19.910569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9458aa-36da-469c-ad55-4639dc68492b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:19.919501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9458aa-36da-469c-ad55-4639dc68492b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:19.920524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9458aa-36da-469c-ad55-4639dc68492b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-0d9458aa-36da-469c-ad55-4639dc68492b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:19.936437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:19.937491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 381/757] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:19.939004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9458aa-36da-469c-ad55-4639dc68492b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:19.983807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdf924-9d39-4da5-86a4-c2a486891be4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:19.998749 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:20.033749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0a2a8-1f36-48dc-bedf-4940bce87e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.035108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0a2a8-1f36-48dc-bedf-4940bce87e21 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.035988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0a2a8-1f36-48dc-bedf-4940bce87e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.036633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0a2a8-1f36-48dc-bedf-4940bce87e21 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.037592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0a2a8-1f36-48dc-bedf-4940bce87e21 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.039599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0a2a8-1f36-48dc-bedf-4940bce87e21 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.044262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:20.054681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9458aa-36da-469c-ad55-4639dc68492b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4dc0a2a8-1f36-48dc-bedf-4940bce87e21 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:20.058902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:20.059805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 21:59:20.061035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:20.063714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 377/758] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:20.065318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0a2a8-1f36-48dc-bedf-4940bce87e21 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:20.098040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c1552-90c7-41c4-b7c1-f7043ffbb44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.098883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c1552-90c7-41c4-b7c1-f7043ffbb44f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.099441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c1552-90c7-41c4-b7c1-f7043ffbb44f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.099575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c1552-90c7-41c4-b7c1-f7043ffbb44f None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.100471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c1552-90c7-41c4-b7c1-f7043ffbb44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:20.100786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c1552-90c7-41c4-b7c1-f7043ffbb44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.102263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c1552-90c7-41c4-b7c1-f7043ffbb44f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.116268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 382/759] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:20.117422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c1552-90c7-41c4-b7c1-f7043ffbb44f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:20.185443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0a2a8-1f36-48dc-bedf-4940bce87e21 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.221599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c4154-e14a-48bd-8099-b4cb35781756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.222416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4154-e14a-48bd-8099-b4cb35781756 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.223018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4154-e14a-48bd-8099-b4cb35781756 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.223542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4154-e14a-48bd-8099-b4cb35781756 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.224424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c4154-e14a-48bd-8099-b4cb35781756 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:20.224738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c4154-e14a-48bd-8099-b4cb35781756 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.225381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c1552-90c7-41c4-b7c1-f7043ffbb44f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.227773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c4154-e14a-48bd-8099-b4cb35781756 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.239366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:20.245501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 378/760] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 21:59:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:20.246648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2f0e-a98f-44db-8cde-95ba0a74147e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.246943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2f0e-a98f-44db-8cde-95ba0a74147e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.247229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2f0e-a98f-44db-8cde-95ba0a74147e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.248614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 379/761] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:20.254345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2f0e-a98f-44db-8cde-95ba0a74147e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:20.271973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b795b-86f1-42b2-a456-47f444838cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.272655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b795b-86f1-42b2-a456-47f444838cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.272948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b795b-86f1-42b2-a456-47f444838cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.273237 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b795b-86f1-42b2-a456-47f444838cc1 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.273949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b795b-86f1-42b2-a456-47f444838cc1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:20.274260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b795b-86f1-42b2-a456-47f444838cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.275641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b795b-86f1-42b2-a456-47f444838cc1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.280296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 383/762] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 21:59:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:20.285726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b795b-86f1-42b2-a456-47f444838cc1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:20.306853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:20.366406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2f0e-a98f-44db-8cde-95ba0a74147e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.395278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b795b-86f1-42b2-a456-47f444838cc1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.402101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f455a5-86b9-4142-8dba-ed5df9e43458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.402902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f455a5-86b9-4142-8dba-ed5df9e43458 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.403190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f455a5-86b9-4142-8dba-ed5df9e43458 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.403471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f455a5-86b9-4142-8dba-ed5df9e43458 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.411392 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f455a5-86b9-4142-8dba-ed5df9e43458 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.412818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f455a5-86b9-4142-8dba-ed5df9e43458 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-48f455a5-86b9-4142-8dba-ed5df9e43458 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:20.428197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:20.429127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:20.430058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:20.430058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:20.430058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:20.430058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:20.430058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:20.430058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:20.430058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:20.430058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:20.430058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 380/763] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:20.431058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56695aff-bdaa-4005-ba9d-2b9b0026e6fb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.431058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56695aff-bdaa-4005-ba9d-2b9b0026e6fb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.431237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56695aff-bdaa-4005-ba9d-2b9b0026e6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.437198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad598-67fe-4b47-b458-92e54e0901d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.437796 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad598-67fe-4b47-b458-92e54e0901d5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.438085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad598-67fe-4b47-b458-92e54e0901d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.438365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad598-67fe-4b47-b458-92e54e0901d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.448468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-56695aff-bdaa-4005-ba9d-2b9b0026e6fb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:20.449680 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-56695aff-bdaa-4005-ba9d-2b9b0026e6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:20.485900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:20.514826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ad598-67fe-4b47-b458-92e54e0901d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.516328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ad598-67fe-4b47-b458-92e54e0901d5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.528171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 381/764] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:20.528171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56695aff-bdaa-4005-ba9d-2b9b0026e6fb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:20.569776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:20.629809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 384/765] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 21:59:20.630760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad598-67fe-4b47-b458-92e54e0901d5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:20.645772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56695aff-bdaa-4005-ba9d-2b9b0026e6fb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.683083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7f421-f0d8-43c3-83ca-c34ae3033372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.683754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f421-f0d8-43c3-83ca-c34ae3033372 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.684094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f421-f0d8-43c3-83ca-c34ae3033372 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.684351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f421-f0d8-43c3-83ca-c34ae3033372 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.685061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7f421-f0d8-43c3-83ca-c34ae3033372 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:20.685375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7f421-f0d8-43c3-83ca-c34ae3033372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.686904 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7f421-f0d8-43c3-83ca-c34ae3033372 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.693883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 382/766] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 21:59:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:20.694607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7f421-f0d8-43c3-83ca-c34ae3033372 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:20.714819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:20.743852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad598-67fe-4b47-b458-92e54e0901d5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.778598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa35dd-6c5c-4a44-8c8d-9d971b92a19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.779257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa35dd-6c5c-4a44-8c8d-9d971b92a19f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.779544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa35dd-6c5c-4a44-8c8d-9d971b92a19f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.779824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa35dd-6c5c-4a44-8c8d-9d971b92a19f None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.780658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa35dd-6c5c-4a44-8c8d-9d971b92a19f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:20.780971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa35dd-6c5c-4a44-8c8d-9d971b92a19f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.782404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa35dd-6c5c-4a44-8c8d-9d971b92a19f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.798180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:20.800921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 385/767] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:20.801716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa35dd-6c5c-4a44-8c8d-9d971b92a19f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:20.802462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7f421-f0d8-43c3-83ca-c34ae3033372 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.838988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97644dd6-b944-4b7c-9065-896fe0ae0728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.839835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97644dd6-b944-4b7c-9065-896fe0ae0728 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.840156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97644dd6-b944-4b7c-9065-896fe0ae0728 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.840435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97644dd6-b944-4b7c-9065-896fe0ae0728 None admin] PATH_INFO: `/v3/services/network` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.841088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97644dd6-b944-4b7c-9065-896fe0ae0728 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.842442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97644dd6-b944-4b7c-9065-896fe0ae0728 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-97644dd6-b944-4b7c-9065-896fe0ae0728 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:20.856662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:20.857751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 21:59:20.858596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:20.859340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 383/768] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:20 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:20.859939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97644dd6-b944-4b7c-9065-896fe0ae0728 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:20.913797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa35dd-6c5c-4a44-8c8d-9d971b92a19f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.950851 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c7f38-0fcd-4b56-9f65-9ebca4f0e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:20.951562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c7f38-0fcd-4b56-9f65-9ebca4f0e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:20.951854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c7f38-0fcd-4b56-9f65-9ebca4f0e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:20.952156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c7f38-0fcd-4b56-9f65-9ebca4f0e9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:20.954295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:20.965498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c7f38-0fcd-4b56-9f65-9ebca4f0e9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:20.967184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c7f38-0fcd-4b56-9f65-9ebca4f0e9d0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:20.973352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97644dd6-b944-4b7c-9065-896fe0ae0728 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-072c7f38-0fcd-4b56-9f65-9ebca4f0e9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:20.987138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:20.988094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:20.988977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:20.988977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:20.988977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:20.988977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:20.988977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 386/769] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:20.989706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c7f38-0fcd-4b56-9f65-9ebca4f0e9d0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.014016 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0372be9-329f-43e3-8747-303bb1ef77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:21.014939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0372be9-329f-43e3-8747-303bb1ef77c4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:21.015225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0372be9-329f-43e3-8747-303bb1ef77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:21.015504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0372be9-329f-43e3-8747-303bb1ef77c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:21.016341 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0372be9-329f-43e3-8747-303bb1ef77c4 None admin] RBAC: Adding query filter params (interface=public, service_id=d52fb9d6d0b24b3ea3a2bdfdeb8d2f53, region_id=RegionOne) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:21.016657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0372be9-329f-43e3-8747-303bb1ef77c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:21.018721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0372be9-329f-43e3-8747-303bb1ef77c4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:21.026137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 384/770] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 21:59:20 2022] GET /identity/v3/endpoints?service_id=d52fb9d6d0b24b3ea3a2bdfdeb8d2f53&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:21.026791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0372be9-329f-43e3-8747-303bb1ef77c4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.058072 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:21.098322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c7f38-0fcd-4b56-9f65-9ebca4f0e9d0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:21.138696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40e1d-004b-4dec-aa4b-77a6b880ed06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:21.139586 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40e1d-004b-4dec-aa4b-77a6b880ed06 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:21.139873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40e1d-004b-4dec-aa4b-77a6b880ed06 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:21.140127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0372be9-329f-43e3-8747-303bb1ef77c4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:21.140229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40e1d-004b-4dec-aa4b-77a6b880ed06 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/44e6d786ac4a40468794b18cfedfa730/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:21.142156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf40e1d-004b-4dec-aa4b-77a6b880ed06 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=44e6d786ac4a40468794b18cfedfa730, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:21.144143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf40e1d-004b-4dec-aa4b-77a6b880ed06 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:21.158740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 387/771] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:20 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/44e6d786ac4a40468794b18cfedfa730/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:59:21.159813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40e1d-004b-4dec-aa4b-77a6b880ed06 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.176178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400900-a1ec-4416-a0b4-5180ba20cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:21.176874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400900-a1ec-4416-a0b4-5180ba20cb1a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:21.177158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400900-a1ec-4416-a0b4-5180ba20cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:21.177441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400900-a1ec-4416-a0b4-5180ba20cb1a None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:21.178175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85400900-a1ec-4416-a0b4-5180ba20cb1a None admin] RBAC: Adding query filter params (name=network) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:21.178487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85400900-a1ec-4416-a0b4-5180ba20cb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:21.179930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85400900-a1ec-4416-a0b4-5180ba20cb1a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:21.190780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 385/772] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:21.191787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400900-a1ec-4416-a0b4-5180ba20cb1a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.232366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:21.299599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40e1d-004b-4dec-aa4b-77a6b880ed06 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:21.307365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:21.318496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400900-a1ec-4416-a0b4-5180ba20cb1a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:21.346409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438df03-d04e-44d9-832c-70db790615b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:21.347661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438df03-d04e-44d9-832c-70db790615b9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:21.348282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438df03-d04e-44d9-832c-70db790615b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:21.348772 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438df03-d04e-44d9-832c-70db790615b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:21.350117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438df03-d04e-44d9-832c-70db790615b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:21.350636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438df03-d04e-44d9-832c-70db790615b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:21.352557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438df03-d04e-44d9-832c-70db790615b9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:21.362399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990dc2-e647-4667-b367-d81bff4e0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:21.363077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990dc2-e647-4667-b367-d81bff4e0572 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:21.363359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990dc2-e647-4667-b367-d81bff4e0572 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:21.363635 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990dc2-e647-4667-b367-d81bff4e0572 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:21.364376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990dc2-e647-4667-b367-d81bff4e0572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:21.365726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990dc2-e647-4667-b367-d81bff4e0572 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:21.370040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 388/773] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:21.371184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438df03-d04e-44d9-832c-70db790615b9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.378036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 386/774] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 21:59:21 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:21.378036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990dc2-e647-4667-b367-d81bff4e0572 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.493447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438df03-d04e-44d9-832c-70db790615b9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:21.503954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:21.511983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990dc2-e647-4667-b367-d81bff4e0572 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:21.568354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b6674-ed67-4ac9-90cf-38c1fdfc1fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:21.569037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b6674-ed67-4ac9-90cf-38c1fdfc1fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:21.569323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b6674-ed67-4ac9-90cf-38c1fdfc1fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:21.569608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b6674-ed67-4ac9-90cf-38c1fdfc1fb6 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:21.570344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b6674-ed67-4ac9-90cf-38c1fdfc1fb6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:21.570654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b6674-ed67-4ac9-90cf-38c1fdfc1fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:21.572076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b6674-ed67-4ac9-90cf-38c1fdfc1fb6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:21.583741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 389/775] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:21.588600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a64340-de53-4dd5-becd-e042ac59ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:21.589436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a64340-de53-4dd5-becd-e042ac59ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:21.589727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a64340-de53-4dd5-becd-e042ac59ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:21.590013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a64340-de53-4dd5-becd-e042ac59ffa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:21.594509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b6674-ed67-4ac9-90cf-38c1fdfc1fb6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.604596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a64340-de53-4dd5-becd-e042ac59ffa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:21.606130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a64340-de53-4dd5-becd-e042ac59ffa2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-88a64340-de53-4dd5-becd-e042ac59ffa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:21.624548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:21.625479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:21.626360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:21.626360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:21.626360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:21.626360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:21.626360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:21.626360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:21.626360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:21.626360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:21.626360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 387/776] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:21.632824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a64340-de53-4dd5-becd-e042ac59ffa2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.658023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:21.729967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b6674-ed67-4ac9-90cf-38c1fdfc1fb6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:21.761849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a64340-de53-4dd5-becd-e042ac59ffa2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:21.804689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17dd18-158b-4cff-bd73-858cd51048f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:21.805954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17dd18-158b-4cff-bd73-858cd51048f0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:21.806442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17dd18-158b-4cff-bd73-858cd51048f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:21.806955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17dd18-158b-4cff-bd73-858cd51048f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:21.807979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17dd18-158b-4cff-bd73-858cd51048f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:21.808512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17dd18-158b-4cff-bd73-858cd51048f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:21.810135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17dd18-158b-4cff-bd73-858cd51048f0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:21.817222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e7770-e606-4a5b-b44e-28ca329a1a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:21.817903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e7770-e606-4a5b-b44e-28ca329a1a9b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:21.818192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e7770-e606-4a5b-b44e-28ca329a1a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:21.818472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e7770-e606-4a5b-b44e-28ca329a1a9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:21.819547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e7770-e606-4a5b-b44e-28ca329a1a9b None admin] RBAC: Adding query filter params (interface=public, service_id=6a0c2d6e64b54045ae6b4d317ad26f49, region_id=RegionOne) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:21.819660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e7770-e606-4a5b-b44e-28ca329a1a9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:21.820983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e7770-e606-4a5b-b44e-28ca329a1a9b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:21.825886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 388/777] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:21.833630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17dd18-158b-4cff-bd73-858cd51048f0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.835794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 390/778] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 21:59:21 2022] GET /identity/v3/endpoints?service_id=6a0c2d6e64b54045ae6b4d317ad26f49&interface=public®ion_id=RegionOne => generated 194 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:21.842513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e7770-e606-4a5b-b44e-28ca329a1a9b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:21.890202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:21.962537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:21.967028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e7770-e606-4a5b-b44e-28ca329a1a9b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:21.988530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17dd18-158b-4cff-bd73-858cd51048f0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:22.002674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a867f-6fb3-4b55-8440-4c59d872e96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:22.003637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a867f-6fb3-4b55-8440-4c59d872e96b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:22.003637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a867f-6fb3-4b55-8440-4c59d872e96b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:22.004041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a867f-6fb3-4b55-8440-4c59d872e96b None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:22.004639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a867f-6fb3-4b55-8440-4c59d872e96b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:22.006023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a867f-6fb3-4b55-8440-4c59d872e96b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:22.016003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 391/779] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 21:59:21 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:22.016003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0479c-eeeb-40b0-b44a-e95fa6789d50 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:22.016003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0479c-eeeb-40b0-b44a-e95fa6789d50 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:22.016003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0479c-eeeb-40b0-b44a-e95fa6789d50 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:22.016003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 392/780] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:22.032481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb21949-9542-49e0-9b08-45859976a0d4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:22.032787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb21949-9542-49e0-9b08-45859976a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:22.036115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb21949-9542-49e0-9b08-45859976a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:22.062889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39744257-3114-4b5a-a436-2934fca606d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:22.063609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744257-3114-4b5a-a436-2934fca606d3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:22.063916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744257-3114-4b5a-a436-2934fca606d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:22.064715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744257-3114-4b5a-a436-2934fca606d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:22.065800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39744257-3114-4b5a-a436-2934fca606d3 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=63cf0ef7c80d4527ae14a6db28bbbc39) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:22.066128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39744257-3114-4b5a-a436-2934fca606d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:22.067657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39744257-3114-4b5a-a436-2934fca606d3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:22.069071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5eb21949-9542-49e0-9b08-45859976a0d4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:22.070317 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5eb21949-9542-49e0-9b08-45859976a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:22.089642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 389/781] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:21 2022] GET /identity/v3/role_assignments?user.id=63cf0ef7c80d4527ae14a6db28bbbc39&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:22.176298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 393/782] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:22.196309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39744257-3114-4b5a-a436-2934fca606d3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:22.334412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39744257-3114-4b5a-a436-2934fca606d3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:22.371601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93cfb-385a-4bee-8818-fc368b8db01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:22.372432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93cfb-385a-4bee-8818-fc368b8db01a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:22.372720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93cfb-385a-4bee-8818-fc368b8db01a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:22.372999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93cfb-385a-4bee-8818-fc368b8db01a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:22.381175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:22.385282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be93cfb-385a-4bee-8818-fc368b8db01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-1be93cfb-385a-4bee-8818-fc368b8db01a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:22.394079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:22.394997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:22.395830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 390/783] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:22.404849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb21949-9542-49e0-9b08-45859976a0d4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:22.444066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:22.550325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb21949-9542-49e0-9b08-45859976a0d4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:22.586767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d86d-3b4a-4abb-b3af-e307215e4457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:22.587359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d86d-3b4a-4abb-b3af-e307215e4457 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:22.587647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d86d-3b4a-4abb-b3af-e307215e4457 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:22.587951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d86d-3b4a-4abb-b3af-e307215e4457 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:22.588715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d86d-3b4a-4abb-b3af-e307215e4457 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:22.589025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d86d-3b4a-4abb-b3af-e307215e4457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:22.590399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d86d-3b4a-4abb-b3af-e307215e4457 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:22.599628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 394/784] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:22.605091 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93cfb-385a-4bee-8818-fc368b8db01a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:22.759717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93cfb-385a-4bee-8818-fc368b8db01a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:22.813547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1331caa-a1bb-4456-b836-7f260c6820be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:22.814888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1331caa-a1bb-4456-b836-7f260c6820be None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:22.815174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1331caa-a1bb-4456-b836-7f260c6820be None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:22.815455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1331caa-a1bb-4456-b836-7f260c6820be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:22.827279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1331caa-a1bb-4456-b836-7f260c6820be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:22.828745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1331caa-a1bb-4456-b836-7f260c6820be None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c1331caa-a1bb-4456-b836-7f260c6820be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:22.853755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:22.854649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:22.855564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:22.855564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:22.855564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:22.855564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:22.855564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 391/785] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:22.862775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d86d-3b4a-4abb-b3af-e307215e4457 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:23.013350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:23.024289 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d86d-3b4a-4abb-b3af-e307215e4457 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:23.076640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebea9-3b1c-42f3-baf0-4d63b39ecd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:23.077310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebea9-3b1c-42f3-baf0-4d63b39ecd03 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:23.077598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebea9-3b1c-42f3-baf0-4d63b39ecd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:23.077875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebea9-3b1c-42f3-baf0-4d63b39ecd03 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:23.078605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbebea9-3b1c-42f3-baf0-4d63b39ecd03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:23.078913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbebea9-3b1c-42f3-baf0-4d63b39ecd03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:23.081060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbebea9-3b1c-42f3-baf0-4d63b39ecd03 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:23.094971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 395/786] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:23.104063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1331caa-a1bb-4456-b836-7f260c6820be None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:23.222494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:23.284687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1331caa-a1bb-4456-b836-7f260c6820be None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:23.337514 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0c2a4-8c43-4f39-aad0-a5d6af146c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:23.338321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0c2a4-8c43-4f39-aad0-a5d6af146c6d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:23.338691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0c2a4-8c43-4f39-aad0-a5d6af146c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:23.338967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0c2a4-8c43-4f39-aad0-a5d6af146c6d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:23.346975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0c2a4-8c43-4f39-aad0-a5d6af146c6d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:23.348442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0c2a4-8c43-4f39-aad0-a5d6af146c6d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c6d0c2a4-8c43-4f39-aad0-a5d6af146c6d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:23.363298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:23.364237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:23.365608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 392/787] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:23.370023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebea9-3b1c-42f3-baf0-4d63b39ecd03 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:23.526719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebea9-3b1c-42f3-baf0-4d63b39ecd03 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:23.585027 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb59e3-f7c3-418c-bdee-d5dec12e8862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:23.585715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb59e3-f7c3-418c-bdee-d5dec12e8862 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:23.585996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb59e3-f7c3-418c-bdee-d5dec12e8862 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:23.586097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e73c44-ad7e-46fe-9be9-d94f953135aa None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:23.586279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb59e3-f7c3-418c-bdee-d5dec12e8862 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:23.586383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e73c44-ad7e-46fe-9be9-d94f953135aa None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:23.586553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e73c44-ad7e-46fe-9be9-d94f953135aa None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:23.587111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb59e3-f7c3-418c-bdee-d5dec12e8862 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:23.587418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb59e3-f7c3-418c-bdee-d5dec12e8862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:23.588214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 393/788] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:23.588936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb59e3-f7c3-418c-bdee-d5dec12e8862 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:23.605363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b73044-d29f-4df6-a5cb-655a3bc77d64 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:23.605649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b73044-d29f-4df6-a5cb-655a3bc77d64 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:23.605922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b73044-d29f-4df6-a5cb-655a3bc77d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:23.609745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 396/789] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 21:59:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:23.615929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb59e3-f7c3-418c-bdee-d5dec12e8862 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:23.629001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a1b73044-d29f-4df6-a5cb-655a3bc77d64 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:23.630312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a1b73044-d29f-4df6-a5cb-655a3bc77d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:23.631513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:23.757957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 394/790] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:23.785333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb59e3-f7c3-418c-bdee-d5dec12e8862 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:23.800195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b73044-d29f-4df6-a5cb-655a3bc77d64 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:23.848321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843f21d-24d5-4528-b22c-7465e8ca0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:23.851575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843f21d-24d5-4528-b22c-7465e8ca0417 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:23.852116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843f21d-24d5-4528-b22c-7465e8ca0417 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:23.852617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843f21d-24d5-4528-b22c-7465e8ca0417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:23.874381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:23.880356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843f21d-24d5-4528-b22c-7465e8ca0417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:23.881817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843f21d-24d5-4528-b22c-7465e8ca0417 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-1843f21d-24d5-4528-b22c-7465e8ca0417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:23.909765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:23.910698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:23.911588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:23.911588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:23.911588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:23.911588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:23.916519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 397/791] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:23.925270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843f21d-24d5-4528-b22c-7465e8ca0417 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:23.974475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b73044-d29f-4df6-a5cb-655a3bc77d64 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.015427 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:24.041402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ebecf-dad7-496f-b422-e0d1a3900bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.042207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ebecf-dad7-496f-b422-e0d1a3900bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.042997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ebecf-dad7-496f-b422-e0d1a3900bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.043282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ebecf-dad7-496f-b422-e0d1a3900bd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.058251 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ebecf-dad7-496f-b422-e0d1a3900bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:24.068303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843f21d-24d5-4528-b22c-7465e8ca0417 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-254ebecf-dad7-496f-b422-e0d1a3900bd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:24.068730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:24.069611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:24.070431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:24.072240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 395/792] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:24.072647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061744-0d32-4d58-8105-6dfb3e99fe5a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.072935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061744-0d32-4d58-8105-6dfb3e99fe5a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.073215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061744-0d32-4d58-8105-6dfb3e99fe5a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.076132 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 396/793] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:24.077678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061744-0d32-4d58-8105-6dfb3e99fe5a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.123813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175be9a-e0bb-4330-86d0-6ced9c08bd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.124559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175be9a-e0bb-4330-86d0-6ced9c08bd81 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.124789 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175be9a-e0bb-4330-86d0-6ced9c08bd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.125066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175be9a-e0bb-4330-86d0-6ced9c08bd81 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.125795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175be9a-e0bb-4330-86d0-6ced9c08bd81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:24.126107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175be9a-e0bb-4330-86d0-6ced9c08bd81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.127508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175be9a-e0bb-4330-86d0-6ced9c08bd81 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:24.145285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 398/794] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:24.146508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8f824-e1d1-4163-861b-4935b0590cf8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.146797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8f824-e1d1-4163-861b-4935b0590cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.147076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8f824-e1d1-4163-861b-4935b0590cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.164202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-eaf8f824-e1d1-4163-861b-4935b0590cf8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:24.165390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-eaf8f824-e1d1-4163-861b-4935b0590cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:24.206688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061744-0d32-4d58-8105-6dfb3e99fe5a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.208987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:24.236585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 399/795] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:24.237498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8f824-e1d1-4163-861b-4935b0590cf8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.262393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913b4c-3628-477c-9eef-cd2e41b15f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.263070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913b4c-3628-477c-9eef-cd2e41b15f74 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.263354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913b4c-3628-477c-9eef-cd2e41b15f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.263630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913b4c-3628-477c-9eef-cd2e41b15f74 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.264424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913b4c-3628-477c-9eef-cd2e41b15f74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:24.264733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913b4c-3628-477c-9eef-cd2e41b15f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.266398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913b4c-3628-477c-9eef-cd2e41b15f74 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:24.286352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 397/796] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:24.287418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913b4c-3628-477c-9eef-cd2e41b15f74 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.310381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:24.365848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8f824-e1d1-4163-861b-4935b0590cf8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.402804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067dc1d-8cc2-4d2d-a3d1-e4a987cb6e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.403971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067dc1d-8cc2-4d2d-a3d1-e4a987cb6e67 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.404457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067dc1d-8cc2-4d2d-a3d1-e4a987cb6e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.404954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067dc1d-8cc2-4d2d-a3d1-e4a987cb6e67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.413742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067dc1d-8cc2-4d2d-a3d1-e4a987cb6e67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.415211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067dc1d-8cc2-4d2d-a3d1-e4a987cb6e67 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:24.426307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913b4c-3628-477c-9eef-cd2e41b15f74 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-5067dc1d-8cc2-4d2d-a3d1-e4a987cb6e67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:24.435399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:24.436500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:24.437369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:24.437369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:24.437369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:24.437369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:24.437369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:24.437369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:24.437369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:24.437369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:24.437977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 400/797] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:24.451921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067dc1d-8cc2-4d2d-a3d1-e4a987cb6e67 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.469878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6d6f-68ed-44e2-918c-248c5f20681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.471292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6d6f-68ed-44e2-918c-248c5f20681f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.471575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6d6f-68ed-44e2-918c-248c5f20681f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.471851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6d6f-68ed-44e2-918c-248c5f20681f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.472634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b6d6f-68ed-44e2-918c-248c5f20681f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.473996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b6d6f-68ed-44e2-918c-248c5f20681f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c44b6d6f-68ed-44e2-918c-248c5f20681f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:24.486520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:24.487454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:24.489232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 398/798] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jul 13 21:59:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:24.490304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6d6f-68ed-44e2-918c-248c5f20681f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.531583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:24.562211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067dc1d-8cc2-4d2d-a3d1-e4a987cb6e67 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.574330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:24.601853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebe1bf-1345-4469-b7a5-95fc5318332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.602841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebe1bf-1345-4469-b7a5-95fc5318332b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.603241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebe1bf-1345-4469-b7a5-95fc5318332b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.603613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebe1bf-1345-4469-b7a5-95fc5318332b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.616114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebe1bf-1345-4469-b7a5-95fc5318332b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.617743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebe1bf-1345-4469-b7a5-95fc5318332b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:24.622747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6d6f-68ed-44e2-918c-248c5f20681f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c2ebe1bf-1345-4469-b7a5-95fc5318332b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:24.636320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:24.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:24.639684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:24.639684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:24.639684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:24.639684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:24.639684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 401/799] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:24.640341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebe1bf-1345-4469-b7a5-95fc5318332b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.663399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07e4ec-80d9-45ad-844a-de25ef76bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.664019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07e4ec-80d9-45ad-844a-de25ef76bf43 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.664310 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07e4ec-80d9-45ad-844a-de25ef76bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.664592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07e4ec-80d9-45ad-844a-de25ef76bf43 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.665850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07e4ec-80d9-45ad-844a-de25ef76bf43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:24.666442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07e4ec-80d9-45ad-844a-de25ef76bf43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.668090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07e4ec-80d9-45ad-844a-de25ef76bf43 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:24.685014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 399/800] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:24.685871 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07e4ec-80d9-45ad-844a-de25ef76bf43 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.755257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebe1bf-1345-4469-b7a5-95fc5318332b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.776553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:24.788176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bb1e7-1b89-4260-b710-c00df7d0fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.788331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07e4ec-80d9-45ad-844a-de25ef76bf43 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.788842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bb1e7-1b89-4260-b710-c00df7d0fd9c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.789130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bb1e7-1b89-4260-b710-c00df7d0fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.789408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bb1e7-1b89-4260-b710-c00df7d0fd9c None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.790115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bb1e7-1b89-4260-b710-c00df7d0fd9c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:24.790424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bb1e7-1b89-4260-b710-c00df7d0fd9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.791788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bb1e7-1b89-4260-b710-c00df7d0fd9c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:24.796182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 402/801] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 21:59:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:24.796928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bb1e7-1b89-4260-b710-c00df7d0fd9c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.821494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a36e7-ea1e-407e-87e2-9989ec17c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.822154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a36e7-ea1e-407e-87e2-9989ec17c281 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.822436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a36e7-ea1e-407e-87e2-9989ec17c281 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.822711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a36e7-ea1e-407e-87e2-9989ec17c281 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.823424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a36e7-ea1e-407e-87e2-9989ec17c281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:24.823726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a36e7-ea1e-407e-87e2-9989ec17c281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.824854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:24.825102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a36e7-ea1e-407e-87e2-9989ec17c281 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:24.837167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 400/802] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:24.838408 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b11e6-36fa-4be8-b455-0e9e59a4265e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.838699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b11e6-36fa-4be8-b455-0e9e59a4265e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.838983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b11e6-36fa-4be8-b455-0e9e59a4265e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.840231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 401/803] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:24.841283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ca657-33ed-4e0f-9cb0-134fdc6157fa None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.841835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ca657-33ed-4e0f-9cb0-134fdc6157fa None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.842121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ca657-33ed-4e0f-9cb0-134fdc6157fa None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.843320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 402/804] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:24.844029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ca657-33ed-4e0f-9cb0-134fdc6157fa None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.902230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bb1e7-1b89-4260-b710-c00df7d0fd9c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.935159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb008df-c592-48af-9424-6c1ef7b6fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.936109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb008df-c592-48af-9424-6c1ef7b6fc4e None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.936295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb008df-c592-48af-9424-6c1ef7b6fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.936571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb008df-c592-48af-9424-6c1ef7b6fc4e None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/2695a36b9b38450981588c31c2b9afc7/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.938573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb008df-c592-48af-9424-6c1ef7b6fc4e None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=2695a36b9b38450981588c31c2b9afc7, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.940817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb008df-c592-48af-9424-6c1ef7b6fc4e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:24.947807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ca657-33ed-4e0f-9cb0-134fdc6157fa None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:24.952830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 403/805] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:24 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/2695a36b9b38450981588c31c2b9afc7/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:59:24.953615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb008df-c592-48af-9424-6c1ef7b6fc4e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:24.985246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e449c-5cbd-40e2-b954-e88086d34caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:24.986699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e449c-5cbd-40e2-b954-e88086d34caf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:24.986990 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e449c-5cbd-40e2-b954-e88086d34caf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:24.987350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e449c-5cbd-40e2-b954-e88086d34caf None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:24.988034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e449c-5cbd-40e2-b954-e88086d34caf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:24.988351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e449c-5cbd-40e2-b954-e88086d34caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:24.989763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e449c-5cbd-40e2-b954-e88086d34caf None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:25.000563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 403/806] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 21:59:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:25.000563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857242-a9a6-45b8-a407-2aec612eac02 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.000563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857242-a9a6-45b8-a407-2aec612eac02 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.000563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857242-a9a6-45b8-a407-2aec612eac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.016620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-36857242-a9a6-45b8-a407-2aec612eac02 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:25.018287 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-36857242-a9a6-45b8-a407-2aec612eac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:25.027393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:25.063350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:25.081063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb008df-c592-48af-9424-6c1ef7b6fc4e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:25.098592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 404/807] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:25.105356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393c184-e750-43bd-84a5-ecd7017494ad None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.105646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393c184-e750-43bd-84a5-ecd7017494ad None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.105923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393c184-e750-43bd-84a5-ecd7017494ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.132781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8393c184-e750-43bd-84a5-ecd7017494ad None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:25.133106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d88b-972f-48d9-918d-521004a578be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:25.133916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d88b-972f-48d9-918d-521004a578be None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.134116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8393c184-e750-43bd-84a5-ecd7017494ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:25.134218 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d88b-972f-48d9-918d-521004a578be None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.134465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d88b-972f-48d9-918d-521004a578be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.143875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3d88b-972f-48d9-918d-521004a578be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:25.144711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3d88b-972f-48d9-918d-521004a578be None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-9cb3d88b-972f-48d9-918d-521004a578be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:25.159227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:25.160297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:25.161234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 404/808] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 21:59:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:25.161830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d88b-972f-48d9-918d-521004a578be None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:25.212030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 405/809] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:25.212808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393c184-e750-43bd-84a5-ecd7017494ad None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:25.279198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d88b-972f-48d9-918d-521004a578be None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:25.297867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:25.316490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875ec8b-5a35-4c6e-9213-7792049dbd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:25.317160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875ec8b-5a35-4c6e-9213-7792049dbd47 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.317562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875ec8b-5a35-4c6e-9213-7792049dbd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.317845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875ec8b-5a35-4c6e-9213-7792049dbd47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.318599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875ec8b-5a35-4c6e-9213-7792049dbd47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:25.320005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875ec8b-5a35-4c6e-9213-7792049dbd47 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:25.336126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393c184-e750-43bd-84a5-ecd7017494ad None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:25.351926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 405/810] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 21:59:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:25.351926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875ec8b-5a35-4c6e-9213-7792049dbd47 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:25.356223 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:25.386936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7eedc-93ce-40e4-ade5-93e935eee987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:25.388074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7eedc-93ce-40e4-ade5-93e935eee987 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.388374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7eedc-93ce-40e4-ade5-93e935eee987 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.388655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7eedc-93ce-40e4-ade5-93e935eee987 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.405569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7eedc-93ce-40e4-ade5-93e935eee987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e7c7eedc-93ce-40e4-ade5-93e935eee987 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:25.415434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:25.416492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:25.417455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:25.418107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 406/811] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:25.418683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7eedc-93ce-40e4-ade5-93e935eee987 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:25.492418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875ec8b-5a35-4c6e-9213-7792049dbd47 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:25.532428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14745759-b57c-47f2-9446-49b85a4df5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:25.534000 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14745759-b57c-47f2-9446-49b85a4df5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.534299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14745759-b57c-47f2-9446-49b85a4df5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.534585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14745759-b57c-47f2-9446-49b85a4df5e2 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.535757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14745759-b57c-47f2-9446-49b85a4df5e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:25.536133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14745759-b57c-47f2-9446-49b85a4df5e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:25.537584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14745759-b57c-47f2-9446-49b85a4df5e2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:25.553588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7eedc-93ce-40e4-ade5-93e935eee987 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:25.560853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 406/812] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 21:59:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:25.562319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14745759-b57c-47f2-9446-49b85a4df5e2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:25.590855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:25.602817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252f65-6944-482a-800e-91586ec9ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:25.604050 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252f65-6944-482a-800e-91586ec9ae83 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.604599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252f65-6944-482a-800e-91586ec9ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.604884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252f65-6944-482a-800e-91586ec9ae83 None admin] PATH_INFO: `/v3/services/network` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.605556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96252f65-6944-482a-800e-91586ec9ae83 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:25.608141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96252f65-6944-482a-800e-91586ec9ae83 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-96252f65-6944-482a-800e-91586ec9ae83 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:25.624352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:25.625406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:25.626259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 407/813] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:25 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:25.627722 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252f65-6944-482a-800e-91586ec9ae83 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:25.645685 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:25.703776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14745759-b57c-47f2-9446-49b85a4df5e2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:25.740259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252f65-6944-482a-800e-91586ec9ae83 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:25.756212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de5ba9-8d8e-4c0a-a353-1e20a9c295e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:25.756620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de5ba9-8d8e-4c0a-a353-1e20a9c295e9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.757965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de5ba9-8d8e-4c0a-a353-1e20a9c295e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.758079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de5ba9-8d8e-4c0a-a353-1e20a9c295e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.758912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de5ba9-8d8e-4c0a-a353-1e20a9c295e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:25.759233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de5ba9-8d8e-4c0a-a353-1e20a9c295e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:25.760630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de5ba9-8d8e-4c0a-a353-1e20a9c295e9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:25.770511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 407/814] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:25.771439 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de5ba9-8d8e-4c0a-a353-1e20a9c295e9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:25.788162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381f859-29e0-433d-970f-5572f582ab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:25.789193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381f859-29e0-433d-970f-5572f582ab9a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.789997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381f859-29e0-433d-970f-5572f582ab9a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.790458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381f859-29e0-433d-970f-5572f582ab9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.865461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:25.877742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381f859-29e0-433d-970f-5572f582ab9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:25.879278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381f859-29e0-433d-970f-5572f582ab9a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:25.905318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de5ba9-8d8e-4c0a-a353-1e20a9c295e9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:25.932138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:25.945934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b37f0a-76a7-40b1-b1ba-ba1c6b6c1b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:25.946700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b37f0a-76a7-40b1-b1ba-ba1c6b6c1b57 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:25.946985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b37f0a-76a7-40b1-b1ba-ba1c6b6c1b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:25.947360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b37f0a-76a7-40b1-b1ba-ba1c6b6c1b57 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:25.948167 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b37f0a-76a7-40b1-b1ba-ba1c6b6c1b57 None admin] RBAC: Adding query filter params (name=network) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:25.948544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b37f0a-76a7-40b1-b1ba-ba1c6b6c1b57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:25.950075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b37f0a-76a7-40b1-b1ba-ba1c6b6c1b57 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:25.959655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 408/815] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:25.959655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b37f0a-76a7-40b1-b1ba-ba1c6b6c1b57 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.000359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 408/816] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 21:59:26.001387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381f859-29e0-433d-970f-5572f582ab9a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.073896 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b37f0a-76a7-40b1-b1ba-ba1c6b6c1b57 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.097054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:26.112384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10664ebf-b7f2-4cb8-b93a-9cb4ac462d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:26.114391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10664ebf-b7f2-4cb8-b93a-9cb4ac462d89 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:26.115849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381f859-29e0-433d-970f-5572f582ab9a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.116397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10664ebf-b7f2-4cb8-b93a-9cb4ac462d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:26.116781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10664ebf-b7f2-4cb8-b93a-9cb4ac462d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:26.131159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10664ebf-b7f2-4cb8-b93a-9cb4ac462d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:26.132804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10664ebf-b7f2-4cb8-b93a-9cb4ac462d89 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-10664ebf-b7f2-4cb8-b93a-9cb4ac462d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:26.150758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:26.151868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:26.152978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:26.152978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:26.152978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:26.152978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:26.154534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 409/817] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:26.155537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10664ebf-b7f2-4cb8-b93a-9cb4ac462d89 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.158129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303a8ae-6b1f-424b-9c66-ec52ccd3cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:26.159225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303a8ae-6b1f-424b-9c66-ec52ccd3cb39 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:26.159715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303a8ae-6b1f-424b-9c66-ec52ccd3cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:26.160258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303a8ae-6b1f-424b-9c66-ec52ccd3cb39 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:26.161157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303a8ae-6b1f-424b-9c66-ec52ccd3cb39 None admin] RBAC: Adding query filter params (type=network) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:26.161608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303a8ae-6b1f-424b-9c66-ec52ccd3cb39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:26.163165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303a8ae-6b1f-424b-9c66-ec52ccd3cb39 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:26.174348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 409/818] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:26.175551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303a8ae-6b1f-424b-9c66-ec52ccd3cb39 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.202653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:26.269889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10664ebf-b7f2-4cb8-b93a-9cb4ac462d89 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.289072 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303a8ae-6b1f-424b-9c66-ec52ccd3cb39 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.307964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4e011-2e60-464c-b8e0-f7eb1b13e161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:26.308985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4e011-2e60-464c-b8e0-f7eb1b13e161 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:26.309373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4e011-2e60-464c-b8e0-f7eb1b13e161 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:26.309778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4e011-2e60-464c-b8e0-f7eb1b13e161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:26.321310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4e011-2e60-464c-b8e0-f7eb1b13e161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:26.323992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4e011-2e60-464c-b8e0-f7eb1b13e161 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:26.332518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ba88-af6e-4220-aae7-3c379a34899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:26.333367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ba88-af6e-4220-aae7-3c379a34899c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:26.333802 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ba88-af6e-4220-aae7-3c379a34899c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:26.334231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ba88-af6e-4220-aae7-3c379a34899c None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:26.335130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ba88-af6e-4220-aae7-3c379a34899c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:26.335681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ba88-af6e-4220-aae7-3c379a34899c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:26.337206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ba88-af6e-4220-aae7-3c379a34899c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f4b4e011-2e60-464c-b8e0-f7eb1b13e161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:26.348159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:26.349220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:26.350288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:26.350288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:26.350288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:26.350288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:26.356097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 410/820] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:26.356326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 410/820] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:26.357245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4e011-2e60-464c-b8e0-f7eb1b13e161 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.357363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ba88-af6e-4220-aae7-3c379a34899c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.377075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:26.457241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:26.467328 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ba88-af6e-4220-aae7-3c379a34899c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.471225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4e011-2e60-464c-b8e0-f7eb1b13e161 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.505568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcfbd3-8f04-4a73-a6e8-372c2b3714ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:26.506585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcfbd3-8f04-4a73-a6e8-372c2b3714ec None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:26.507053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcfbd3-8f04-4a73-a6e8-372c2b3714ec None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:26.507484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcfbd3-8f04-4a73-a6e8-372c2b3714ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:26.508412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcfbd3-8f04-4a73-a6e8-372c2b3714ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:26.510153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcfbd3-8f04-4a73-a6e8-372c2b3714ec None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:26.515593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a7641-6988-46ab-9c84-4db1a6b5270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:26.516930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a7641-6988-46ab-9c84-4db1a6b5270b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:26.517355 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a7641-6988-46ab-9c84-4db1a6b5270b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:26.517735 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a7641-6988-46ab-9c84-4db1a6b5270b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:26.526966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a7641-6988-46ab-9c84-4db1a6b5270b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:26.528863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a7641-6988-46ab-9c84-4db1a6b5270b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:26.535034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 411/821] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 21:59:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:26.536248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcfbd3-8f04-4a73-a6e8-372c2b3714ec None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ce5a7641-6988-46ab-9c84-4db1a6b5270b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:26.546384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:26.547601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:26.548883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:26.550757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 411/822] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 21:59:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:26.561376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a7641-6988-46ab-9c84-4db1a6b5270b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.638833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:26.712631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcfbd3-8f04-4a73-a6e8-372c2b3714ec None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.729002 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a7641-6988-46ab-9c84-4db1a6b5270b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.757414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65be5a-28b7-4c33-9759-208933fcb482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:26.758191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65be5a-28b7-4c33-9759-208933fcb482 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:26.758653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65be5a-28b7-4c33-9759-208933fcb482 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:26.759035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65be5a-28b7-4c33-9759-208933fcb482 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:26.759874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65be5a-28b7-4c33-9759-208933fcb482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:26.760289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65be5a-28b7-4c33-9759-208933fcb482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:26.761945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65be5a-28b7-4c33-9759-208933fcb482 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:26.775796 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8239ae-fd91-49d1-9afe-061daa3e391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:26.776798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8239ae-fd91-49d1-9afe-061daa3e391d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:26.777026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 412/823] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:26.777425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8239ae-fd91-49d1-9afe-061daa3e391d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:26.777715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8239ae-fd91-49d1-9afe-061daa3e391d None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:26.778561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8239ae-fd91-49d1-9afe-061daa3e391d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:26.778876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8239ae-fd91-49d1-9afe-061daa3e391d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:26.785351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8239ae-fd91-49d1-9afe-061daa3e391d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:26.788431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65be5a-28b7-4c33-9759-208933fcb482 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.808552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 412/824] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 21:59:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:26.815917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8239ae-fd91-49d1-9afe-061daa3e391d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:26.828112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:26.931940 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65be5a-28b7-4c33-9759-208933fcb482 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.962761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:26.966301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8239ae-fd91-49d1-9afe-061daa3e391d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:26.973520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530544e-0424-40cd-bc78-1ed404a10f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:26.974369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530544e-0424-40cd-bc78-1ed404a10f5f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:26.974660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530544e-0424-40cd-bc78-1ed404a10f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:26.974944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530544e-0424-40cd-bc78-1ed404a10f5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:26.982694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530544e-0424-40cd-bc78-1ed404a10f5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:26.984371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530544e-0424-40cd-bc78-1ed404a10f5f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:27.005552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6139ee7-5131-4f91-af5c-92c76ce7a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9530544e-0424-40cd-bc78-1ed404a10f5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:27.006189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:27.007044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:27.007941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:27.007941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:27.007941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:27.007941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:27.007941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:27.007941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:27.007941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:27.007941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:27.008378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139ee7-5131-4f91-af5c-92c76ce7a338 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.008378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139ee7-5131-4f91-af5c-92c76ce7a338 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.008378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139ee7-5131-4f91-af5c-92c76ce7a338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.008576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 413/825] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:27.017539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530544e-0424-40cd-bc78-1ed404a10f5f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.018402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6139ee7-5131-4f91-af5c-92c76ce7a338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:27.020036 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6139ee7-5131-4f91-af5c-92c76ce7a338 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e6139ee7-5131-4f91-af5c-92c76ce7a338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:27.044329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:27.045454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:27.046645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:27.046645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:27.046645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:27.046645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:27.046645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 413/826] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:27.052020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6139ee7-5131-4f91-af5c-92c76ce7a338 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.122505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:27.158869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530544e-0424-40cd-bc78-1ed404a10f5f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:27.170705 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6139ee7-5131-4f91-af5c-92c76ce7a338 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:27.196998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82fdb5-cc8b-4390-9186-76856256310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:27.197590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82fdb5-cc8b-4390-9186-76856256310f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.197880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82fdb5-cc8b-4390-9186-76856256310f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.198372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82fdb5-cc8b-4390-9186-76856256310f None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.199018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82fdb5-cc8b-4390-9186-76856256310f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:27.199288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82fdb5-cc8b-4390-9186-76856256310f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:27.200741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82fdb5-cc8b-4390-9186-76856256310f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:27.209631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5573e0-9686-4012-b9cb-3fd83294a8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:27.210291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5573e0-9686-4012-b9cb-3fd83294a8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.211012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5573e0-9686-4012-b9cb-3fd83294a8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.211295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5573e0-9686-4012-b9cb-3fd83294a8c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.212053 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5573e0-9686-4012-b9cb-3fd83294a8c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:27.212363 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5573e0-9686-4012-b9cb-3fd83294a8c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:27.218769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 414/827] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:27.218915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5573e0-9686-4012-b9cb-3fd83294a8c7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:27.218996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e8fc-0df8-4a4f-b1d3-72bbbfb170b1 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.218996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e8fc-0df8-4a4f-b1d3-72bbbfb170b1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.218996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e8fc-0df8-4a4f-b1d3-72bbbfb170b1 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.218996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 415/828] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:27.222947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528e8fc-0df8-4a4f-b1d3-72bbbfb170b1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.235055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 414/829] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:27.235055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2bf18-feca-4f6c-a9f2-a44c2b449a37 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.235055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2bf18-feca-4f6c-a9f2-a44c2b449a37 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.235055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2bf18-feca-4f6c-a9f2-a44c2b449a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.249455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-67e2bf18-feca-4f6c-a9f2-a44c2b449a37 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:27.250634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-67e2bf18-feca-4f6c-a9f2-a44c2b449a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:27.283357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:27.322897 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 415/830] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:27.324071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2bf18-feca-4f6c-a9f2-a44c2b449a37 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.354988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528e8fc-0df8-4a4f-b1d3-72bbbfb170b1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:27.392134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195223fd-ccf0-45a9-ad09-7e528114c1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:27.392340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:27.393133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195223fd-ccf0-45a9-ad09-7e528114c1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.393919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195223fd-ccf0-45a9-ad09-7e528114c1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.394256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195223fd-ccf0-45a9-ad09-7e528114c1f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.395162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195223fd-ccf0-45a9-ad09-7e528114c1f7 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=44e6d786ac4a40468794b18cfedfa730) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:27.395669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195223fd-ccf0-45a9-ad09-7e528114c1f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:27.397137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195223fd-ccf0-45a9-ad09-7e528114c1f7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:27.403460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 416/831] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:27 2022] GET /identity/v3/role_assignments?user.id=44e6d786ac4a40468794b18cfedfa730&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:27.404258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195223fd-ccf0-45a9-ad09-7e528114c1f7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.473819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2bf18-feca-4f6c-a9f2-a44c2b449a37 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:27.515387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e42a04-061b-425f-9019-492447a99aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:27.515870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e42a04-061b-425f-9019-492447a99aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.516192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e42a04-061b-425f-9019-492447a99aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.516472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e42a04-061b-425f-9019-492447a99aa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.525670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e42a04-061b-425f-9019-492447a99aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:27.527169 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e42a04-061b-425f-9019-492447a99aa6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:27.540103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195223fd-ccf0-45a9-ad09-7e528114c1f7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-79e42a04-061b-425f-9019-492447a99aa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:27.543707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:27.544650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:27.545539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:27.545539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:27.545539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:27.545539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:27.545539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:27.545539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:27.545539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:27.545539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:27.545539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 416/832] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:27.551308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e42a04-061b-425f-9019-492447a99aa6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.559991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:27.594707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105bc4e-986d-4fa9-a972-313c06b50a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:27.596151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105bc4e-986d-4fa9-a972-313c06b50a22 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.596449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105bc4e-986d-4fa9-a972-313c06b50a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.596733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105bc4e-986d-4fa9-a972-313c06b50a22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.608803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105bc4e-986d-4fa9-a972-313c06b50a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f105bc4e-986d-4fa9-a972-313c06b50a22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:27.617631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:27.618590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:27.619449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 417/833] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:27.626580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105bc4e-986d-4fa9-a972-313c06b50a22 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.683946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e42a04-061b-425f-9019-492447a99aa6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:27.694595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:27.721126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf5b5b-388d-478c-b606-669093424349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:27.721803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf5b5b-388d-478c-b606-669093424349 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.722093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf5b5b-388d-478c-b606-669093424349 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.722375 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf5b5b-388d-478c-b606-669093424349 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.723170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf5b5b-388d-478c-b606-669093424349 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:27.723487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf5b5b-388d-478c-b606-669093424349 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:27.725016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf5b5b-388d-478c-b606-669093424349 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:27.742816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 417/834] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:27.742816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb961e8-d6fa-4932-8b4d-68bf63e5cd7b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.742816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb961e8-d6fa-4932-8b4d-68bf63e5cd7b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.742816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb961e8-d6fa-4932-8b4d-68bf63e5cd7b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.742816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 418/835] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:27.746056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb961e8-d6fa-4932-8b4d-68bf63e5cd7b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.753647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105bc4e-986d-4fa9-a972-313c06b50a22 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:27.790272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f782666-66ca-4b75-9bf7-f6151e57e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:27.790973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f782666-66ca-4b75-9bf7-f6151e57e91a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.791258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f782666-66ca-4b75-9bf7-f6151e57e91a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.791540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f782666-66ca-4b75-9bf7-f6151e57e91a None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.792430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f782666-66ca-4b75-9bf7-f6151e57e91a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:27.792737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f782666-66ca-4b75-9bf7-f6151e57e91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:27.794311 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f782666-66ca-4b75-9bf7-f6151e57e91a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:27.804399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 418/836] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:27.805799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29964a21-4a53-439f-a310-71ec911475b2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.806094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29964a21-4a53-439f-a310-71ec911475b2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.806372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29964a21-4a53-439f-a310-71ec911475b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.825132 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-29964a21-4a53-439f-a310-71ec911475b2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:27.826330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-29964a21-4a53-439f-a310-71ec911475b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:27.854818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb961e8-d6fa-4932-8b4d-68bf63e5cd7b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:27.855685 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:27.889372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb20830-5cce-4d24-b95a-93112d0d5153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:27.890260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb20830-5cce-4d24-b95a-93112d0d5153 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:27.890542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb20830-5cce-4d24-b95a-93112d0d5153 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:27.890824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb20830-5cce-4d24-b95a-93112d0d5153 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/63cf0ef7c80d4527ae14a6db28bbbc39/roles/c45ff064e30a4a689212d6aee4ed3dd7` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:27.900861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 419/837] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:27.902054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29964a21-4a53-439f-a310-71ec911475b2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.915356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb20830-5cce-4d24-b95a-93112d0d5153 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=63cf0ef7c80d4527ae14a6db28bbbc39, role_id=c45ff064e30a4a689212d6aee4ed3dd7)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:27.917233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb20830-5cce-4d24-b95a-93112d0d5153 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:27.933565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 419/838] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:27 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/63cf0ef7c80d4527ae14a6db28bbbc39/roles/c45ff064e30a4a689212d6aee4ed3dd7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:59:27.945313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb20830-5cce-4d24-b95a-93112d0d5153 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:27.971300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:28.038108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29964a21-4a53-439f-a310-71ec911475b2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:28.075739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb20830-5cce-4d24-b95a-93112d0d5153 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:28.085724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2279ff8-bff5-46e9-8be2-0908512616df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:28.086536 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2279ff8-bff5-46e9-8be2-0908512616df None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:28.086817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2279ff8-bff5-46e9-8be2-0908512616df None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:28.087098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2279ff8-bff5-46e9-8be2-0908512616df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:28.100538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2279ff8-bff5-46e9-8be2-0908512616df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:28.101985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2279ff8-bff5-46e9-8be2-0908512616df None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a2279ff8-bff5-46e9-8be2-0908512616df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:28.125036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:28.126128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:28.127631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:28.127631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:28.127631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:28.127631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:28.131615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 420/839] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:28.132861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2279ff8-bff5-46e9-8be2-0908512616df None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:28.134920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c5cc0-edca-4624-a094-6d95614088be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:28.135878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c5cc0-edca-4624-a094-6d95614088be None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:28.136256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c5cc0-edca-4624-a094-6d95614088be None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:28.136535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c5cc0-edca-4624-a094-6d95614088be None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:28.137234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c5cc0-edca-4624-a094-6d95614088be None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:28.139513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c5cc0-edca-4624-a094-6d95614088be None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-291c5cc0-edca-4624-a094-6d95614088be None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:28.154799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:28.155845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:28.156726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 420/840] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:59:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:28.161615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:28.163940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c5cc0-edca-4624-a094-6d95614088be None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:28.269610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2279ff8-bff5-46e9-8be2-0908512616df None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:28.275048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:28.299270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c5cc0-edca-4624-a094-6d95614088be None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:28.313010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d6176-7487-45cf-930a-49d26b1ec9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:28.314472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6176-7487-45cf-930a-49d26b1ec9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:28.315350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6176-7487-45cf-930a-49d26b1ec9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:28.315829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6176-7487-45cf-930a-49d26b1ec9c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:28.317061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d6176-7487-45cf-930a-49d26b1ec9c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:28.317934 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d6176-7487-45cf-930a-49d26b1ec9c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:28.319658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d6176-7487-45cf-930a-49d26b1ec9c6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:28.336668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c61931-9332-47b3-bed0-aaeed4bb1e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:28.337320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 421/841] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:28.337459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c61931-9332-47b3-bed0-aaeed4bb1e41 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:28.344025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c61931-9332-47b3-bed0-aaeed4bb1e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:28.344025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c61931-9332-47b3-bed0-aaeed4bb1e41 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:28.344025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c61931-9332-47b3-bed0-aaeed4bb1e41 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:28.344025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c61931-9332-47b3-bed0-aaeed4bb1e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:28.344025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c61931-9332-47b3-bed0-aaeed4bb1e41 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:28.344419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d6176-7487-45cf-930a-49d26b1ec9c6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:28.355638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 421/842] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:59:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:28.356739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c61931-9332-47b3-bed0-aaeed4bb1e41 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:28.438747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:28.463370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d6176-7487-45cf-930a-49d26b1ec9c6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:28.473478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c61931-9332-47b3-bed0-aaeed4bb1e41 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:28.499548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a50d57-e784-4681-b424-8ae7488e9a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:28.500522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a50d57-e784-4681-b424-8ae7488e9a57 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:28.500868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a50d57-e784-4681-b424-8ae7488e9a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:28.501148 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a50d57-e784-4681-b424-8ae7488e9a57 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:28.508519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918248db-e5b7-4cf2-adfb-02074c5e3a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:28.509187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918248db-e5b7-4cf2-adfb-02074c5e3a86 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:28.509473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918248db-e5b7-4cf2-adfb-02074c5e3a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:28.509578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a50d57-e784-4681-b424-8ae7488e9a57 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:28.509753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918248db-e5b7-4cf2-adfb-02074c5e3a86 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:28.510464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918248db-e5b7-4cf2-adfb-02074c5e3a86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:28.510773 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918248db-e5b7-4cf2-adfb-02074c5e3a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:28.510875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a50d57-e784-4681-b424-8ae7488e9a57 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:28.512151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918248db-e5b7-4cf2-adfb-02074c5e3a86 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:28.524545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 422/843] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:59:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-41a50d57-e784-4681-b424-8ae7488e9a57 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:28.526007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:28.526917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:28.528184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 422/844] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:28.534987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918248db-e5b7-4cf2-adfb-02074c5e3a86 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:28.556388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:28.655193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918248db-e5b7-4cf2-adfb-02074c5e3a86 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:28.693967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e7c2-e6a7-4b9c-a211-449ad3de0289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:28.695033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e7c2-e6a7-4b9c-a211-449ad3de0289 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:28.695517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e7c2-e6a7-4b9c-a211-449ad3de0289 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:28.696019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e7c2-e6a7-4b9c-a211-449ad3de0289 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:28.697258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250e7c2-e6a7-4b9c-a211-449ad3de0289 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:28.697804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250e7c2-e6a7-4b9c-a211-449ad3de0289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:28.699580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250e7c2-e6a7-4b9c-a211-449ad3de0289 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:28.722460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 423/845] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 21:59:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:28.725647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a50d57-e784-4681-b424-8ae7488e9a57 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:28.838453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a50d57-e784-4681-b424-8ae7488e9a57 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:28.873999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a02280-125a-4bf9-91a4-9ce5a5b7929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:28.874656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a02280-125a-4bf9-91a4-9ce5a5b7929a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:28.874943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a02280-125a-4bf9-91a4-9ce5a5b7929a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:28.875222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a02280-125a-4bf9-91a4-9ce5a5b7929a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:28.878795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:28.946132 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a02280-125a-4bf9-91a4-9ce5a5b7929a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:28.947567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a02280-125a-4bf9-91a4-9ce5a5b7929a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:29.053690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 423/846] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 21:59:29.055099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e7c2-e6a7-4b9c-a211-449ad3de0289 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:29.134092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:29.167562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e7c2-e6a7-4b9c-a211-449ad3de0289 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:29.204517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9dab2-ab91-4116-a939-f2bcdda7f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:29.205515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9dab2-ab91-4116-a939-f2bcdda7f40c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:29.206138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9dab2-ab91-4116-a939-f2bcdda7f40c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:29.206422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9dab2-ab91-4116-a939-f2bcdda7f40c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:29.217729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9dab2-ab91-4116-a939-f2bcdda7f40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:29.219350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9dab2-ab91-4116-a939-f2bcdda7f40c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-7aa9dab2-ab91-4116-a939-f2bcdda7f40c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:29.237242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:29.238186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:29.239286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:29.239286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:29.239286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:29.239286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:29.239286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 424/847] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:29.245621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a02280-125a-4bf9-91a4-9ce5a5b7929a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:29.281890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:29.349726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a02280-125a-4bf9-91a4-9ce5a5b7929a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:29.385621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423bd0-1486-4aa9-baf1-03fba53a2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:29.386647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423bd0-1486-4aa9-baf1-03fba53a2af2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:29.387137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423bd0-1486-4aa9-baf1-03fba53a2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:29.387618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423bd0-1486-4aa9-baf1-03fba53a2af2 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:29.388593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423bd0-1486-4aa9-baf1-03fba53a2af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:29.389123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423bd0-1486-4aa9-baf1-03fba53a2af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:29.390677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423bd0-1486-4aa9-baf1-03fba53a2af2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:29.407180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 424/848] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:29.408873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9dab2-ab91-4116-a939-f2bcdda7f40c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:29.514497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9dab2-ab91-4116-a939-f2bcdda7f40c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:29.538526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:29.552207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3a81-54c1-43fc-a569-9236732ee810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:29.553315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3a81-54c1-43fc-a569-9236732ee810 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:29.553827 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3a81-54c1-43fc-a569-9236732ee810 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:29.554324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3a81-54c1-43fc-a569-9236732ee810 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:29.561657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b3a81-54c1-43fc-a569-9236732ee810 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:29.563347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b3a81-54c1-43fc-a569-9236732ee810 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-d17b3a81-54c1-43fc-a569-9236732ee810 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:29.578707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:29.579703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:29.580736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:29.580736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:29.580736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:29.580736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:29.580736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:29.580736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:29.580736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:29.580736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:29.587978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 425/849] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:29.589463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423bd0-1486-4aa9-baf1-03fba53a2af2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:29.603236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f528bb-6047-4aff-8d98-6192e1aee643 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:29.603524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f528bb-6047-4aff-8d98-6192e1aee643 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:29.603801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f528bb-6047-4aff-8d98-6192e1aee643 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:29.605348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 426/850] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:29.612471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac3c7c-8a0c-491e-abc3-bb3edd770c79 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:29.613016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac3c7c-8a0c-491e-abc3-bb3edd770c79 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:29.613659 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac3c7c-8a0c-491e-abc3-bb3edd770c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:29.633894 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5bac3c7c-8a0c-491e-abc3-bb3edd770c79 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:29.636390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5bac3c7c-8a0c-491e-abc3-bb3edd770c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:29.705610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:29.712463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423bd0-1486-4aa9-baf1-03fba53a2af2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:29.716054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 427/851] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:29.739330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac3c7c-8a0c-491e-abc3-bb3edd770c79 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:29.757633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b3621-ef36-4a71-9d25-87ce8eff6770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:29.758864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b3621-ef36-4a71-9d25-87ce8eff6770 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:29.759440 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b3621-ef36-4a71-9d25-87ce8eff6770 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:29.760074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b3621-ef36-4a71-9d25-87ce8eff6770 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:29.761203 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b3621-ef36-4a71-9d25-87ce8eff6770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:29.761747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b3621-ef36-4a71-9d25-87ce8eff6770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:29.763563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b3621-ef36-4a71-9d25-87ce8eff6770 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:29.779535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 425/852] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:29.787975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b3621-ef36-4a71-9d25-87ce8eff6770 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:29.850568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac3c7c-8a0c-491e-abc3-bb3edd770c79 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:29.865359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:29.889363 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b427a-1617-40b6-a237-b2d8007aeebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:29.890101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b427a-1617-40b6-a237-b2d8007aeebf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:29.890824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b427a-1617-40b6-a237-b2d8007aeebf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:29.891105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b427a-1617-40b6-a237-b2d8007aeebf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:29.892442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b427a-1617-40b6-a237-b2d8007aeebf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:29.894178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b427a-1617-40b6-a237-b2d8007aeebf None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-600b427a-1617-40b6-a237-b2d8007aeebf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:29.911005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:29.911966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 21:59:29.912799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:29.913593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 428/853] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jul 13 21:59:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:29.915142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b3621-ef36-4a71-9d25-87ce8eff6770 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:29.920848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b427a-1617-40b6-a237-b2d8007aeebf None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:29.953018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d81579-e1f6-4660-bfd5-18a863f7e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:29.953688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d81579-e1f6-4660-bfd5-18a863f7e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:29.953974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d81579-e1f6-4660-bfd5-18a863f7e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:29.954255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d81579-e1f6-4660-bfd5-18a863f7e7e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:29.955779 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d81579-e1f6-4660-bfd5-18a863f7e7e2 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=2695a36b9b38450981588c31c2b9afc7) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:29.956116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d81579-e1f6-4660-bfd5-18a863f7e7e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:29.958576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d81579-e1f6-4660-bfd5-18a863f7e7e2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:29.969741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 426/854] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:29 2022] GET /identity/v3/role_assignments?user.id=2695a36b9b38450981588c31c2b9afc7&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:30.046902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b427a-1617-40b6-a237-b2d8007aeebf None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:30.086424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271063a8-24e4-44a5-8ede-e7e4a649f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:30.087097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271063a8-24e4-44a5-8ede-e7e4a649f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.087382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271063a8-24e4-44a5-8ede-e7e4a649f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.087662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271063a8-24e4-44a5-8ede-e7e4a649f6a0 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.088432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271063a8-24e4-44a5-8ede-e7e4a649f6a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:30.088742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271063a8-24e4-44a5-8ede-e7e4a649f6a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:30.090151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271063a8-24e4-44a5-8ede-e7e4a649f6a0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:30.096019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 429/855] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:30.101706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d81579-e1f6-4660-bfd5-18a863f7e7e2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:30.108496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a89d88-f2a0-4521-bb1e-3436a4eb9f6e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.108793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a89d88-f2a0-4521-bb1e-3436a4eb9f6e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.109058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a89d88-f2a0-4521-bb1e-3436a4eb9f6e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.113549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 430/856] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:30.116635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bcd67-c0a4-45a9-9534-7edf97a4d33b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.116979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bcd67-c0a4-45a9-9534-7edf97a4d33b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.117258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bcd67-c0a4-45a9-9534-7edf97a4d33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.138508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-833bcd67-c0a4-45a9-9534-7edf97a4d33b None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:30.139102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-833bcd67-c0a4-45a9-9534-7edf97a4d33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:30.142770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:30.177476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:30.226904 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 431/857] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:30.243535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d81579-e1f6-4660-bfd5-18a863f7e7e2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:30.249865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bcd67-c0a4-45a9-9534-7edf97a4d33b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:30.279061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6f059-2083-4123-a9d9-3c2b369e89ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:30.279877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6f059-2083-4123-a9d9-3c2b369e89ac None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.280194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6f059-2083-4123-a9d9-3c2b369e89ac None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.280744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6f059-2083-4123-a9d9-3c2b369e89ac None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.281747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6f059-2083-4123-a9d9-3c2b369e89ac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:30.282061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6f059-2083-4123-a9d9-3c2b369e89ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:30.284296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6f059-2083-4123-a9d9-3c2b369e89ac None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:30.290314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 427/858] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:30.365081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bcd67-c0a4-45a9-9534-7edf97a4d33b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:30.404104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb107f4-2802-4f3f-8b0e-9589c1d5f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:30.405017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb107f4-2802-4f3f-8b0e-9589c1d5f104 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.405308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb107f4-2802-4f3f-8b0e-9589c1d5f104 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.405585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb107f4-2802-4f3f-8b0e-9589c1d5f104 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.418349 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb107f4-2802-4f3f-8b0e-9589c1d5f104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ffb107f4-2802-4f3f-8b0e-9589c1d5f104 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:30.427741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:30.428786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:30.429664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 432/859] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 21:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:30.437362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6f059-2083-4123-a9d9-3c2b369e89ac None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:30.535969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:30.552446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6f059-2083-4123-a9d9-3c2b369e89ac None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:30.588003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cb90c-95ab-4d88-92fb-1ca46f2c2af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:30.588678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cb90c-95ab-4d88-92fb-1ca46f2c2af8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.588963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cb90c-95ab-4d88-92fb-1ca46f2c2af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.589241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cb90c-95ab-4d88-92fb-1ca46f2c2af8 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.589990 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cb90c-95ab-4d88-92fb-1ca46f2c2af8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:30.590293 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cb90c-95ab-4d88-92fb-1ca46f2c2af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:30.591644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cb90c-95ab-4d88-92fb-1ca46f2c2af8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:30.600467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 428/860] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 21:59:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:30.605618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb107f4-2802-4f3f-8b0e-9589c1d5f104 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:30.637935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:30.714706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb107f4-2802-4f3f-8b0e-9589c1d5f104 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:30.750401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65213-8706-434c-8e5a-58cb08eddb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:30.751594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65213-8706-434c-8e5a-58cb08eddb9b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.752020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65213-8706-434c-8e5a-58cb08eddb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.752473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65213-8706-434c-8e5a-58cb08eddb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.764220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b65213-8706-434c-8e5a-58cb08eddb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:30.765845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b65213-8706-434c-8e5a-58cb08eddb9b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-f1b65213-8706-434c-8e5a-58cb08eddb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:30.784928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:30.787032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:30.788253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:30.788253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:30.788253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:30.788253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:30.788253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 433/861] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:30.791674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cb90c-95ab-4d88-92fb-1ca46f2c2af8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:30.813326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314875e-8fa6-4876-b814-e09702d82aa7 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.813697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314875e-8fa6-4876-b814-e09702d82aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.813947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314875e-8fa6-4876-b814-e09702d82aa7 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.815438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 434/862] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:30.820686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d62b2-1d29-4729-a439-08db2e3cf8cd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.820969 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d62b2-1d29-4729-a439-08db2e3cf8cd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.821250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d62b2-1d29-4729-a439-08db2e3cf8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.839983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f78d62b2-1d29-4729-a439-08db2e3cf8cd None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:30.841351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f78d62b2-1d29-4729-a439-08db2e3cf8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:30.916038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cb90c-95ab-4d88-92fb-1ca46f2c2af8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:30.924613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 435/863] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:30.946995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d62b2-1d29-4729-a439-08db2e3cf8cd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:30.958733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee07b5-3c76-4388-9f8a-81398235329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:30.959848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee07b5-3c76-4388-9f8a-81398235329b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:30.960170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee07b5-3c76-4388-9f8a-81398235329b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:30.960463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee07b5-3c76-4388-9f8a-81398235329b None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:30.961179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee07b5-3c76-4388-9f8a-81398235329b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:30.961487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee07b5-3c76-4388-9f8a-81398235329b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:30.963538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee07b5-3c76-4388-9f8a-81398235329b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:30.965352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:30.981795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 429/864] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:30.986424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee07b5-3c76-4388-9f8a-81398235329b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:30.999936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:31.071324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d62b2-1d29-4729-a439-08db2e3cf8cd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:31.123011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6909e-714f-4924-b715-dc7f0755dc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:31.124473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6909e-714f-4924-b715-dc7f0755dc73 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:31.124695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee07b5-3c76-4388-9f8a-81398235329b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:31.125172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6909e-714f-4924-b715-dc7f0755dc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:31.125680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6909e-714f-4924-b715-dc7f0755dc73 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:31.127464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6909e-714f-4924-b715-dc7f0755dc73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:31.129876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6909e-714f-4924-b715-dc7f0755dc73 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:31.148622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 436/865] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:59:30 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 21:59:31.174387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a56065-e401-46fc-acb2-cbec623a7a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:31.175229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56065-e401-46fc-acb2-cbec623a7a39 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:31.175511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56065-e401-46fc-acb2-cbec623a7a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:31.175788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56065-e401-46fc-acb2-cbec623a7a39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:31.184672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a56065-e401-46fc-acb2-cbec623a7a39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:31.186164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a56065-e401-46fc-acb2-cbec623a7a39 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-40a56065-e401-46fc-acb2-cbec623a7a39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:31.203323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:31.204516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:31.205692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 430/866] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 21:59:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:31.211043 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6909e-714f-4924-b715-dc7f0755dc73 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:31.299951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:31.336086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6909e-714f-4924-b715-dc7f0755dc73 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:31.373061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd331c04-75bf-4053-861a-15f6a7c92595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:31.373756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd331c04-75bf-4053-861a-15f6a7c92595 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:31.374031 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd331c04-75bf-4053-861a-15f6a7c92595 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:31.374313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd331c04-75bf-4053-861a-15f6a7c92595 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:31.375163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd331c04-75bf-4053-861a-15f6a7c92595 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:31.375477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd331c04-75bf-4053-861a-15f6a7c92595 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:31.377647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd331c04-75bf-4053-861a-15f6a7c92595 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:31.397348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 437/867] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 21:59:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:31.402527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a56065-e401-46fc-acb2-cbec623a7a39 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:31.468425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:31.507458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a56065-e401-46fc-acb2-cbec623a7a39 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:31.542061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a57038-df8b-4fb3-ab20-853e1839c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:31.542711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a57038-df8b-4fb3-ab20-853e1839c22a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:31.542993 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a57038-df8b-4fb3-ab20-853e1839c22a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:31.543268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a57038-df8b-4fb3-ab20-853e1839c22a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:31.618298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a57038-df8b-4fb3-ab20-853e1839c22a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:31.619657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a57038-df8b-4fb3-ab20-853e1839c22a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:31.687266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:31.737103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 431/868] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:31 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 21:59:31.742193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd331c04-75bf-4053-861a-15f6a7c92595 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:31.854456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd331c04-75bf-4053-861a-15f6a7c92595 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:31.886724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:31.894177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daee73-5369-4384-92df-a948d74a3abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:31.894987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daee73-5369-4384-92df-a948d74a3abd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:31.895272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daee73-5369-4384-92df-a948d74a3abd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:31.895553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daee73-5369-4384-92df-a948d74a3abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:31.906422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daee73-5369-4384-92df-a948d74a3abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:31.908611 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daee73-5369-4384-92df-a948d74a3abd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-48daee73-5369-4384-92df-a948d74a3abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:31.927712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:31.928623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:31.929534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:31.929534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:31.929534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:31.929534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:31.929534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 438/869] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:31.935770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a57038-df8b-4fb3-ab20-853e1839c22a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:32.041565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a57038-df8b-4fb3-ab20-853e1839c22a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:32.077018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55481217-795d-42e7-88af-a112a5b40630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:32.077697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55481217-795d-42e7-88af-a112a5b40630 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.077986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55481217-795d-42e7-88af-a112a5b40630 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.078269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55481217-795d-42e7-88af-a112a5b40630 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.078997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55481217-795d-42e7-88af-a112a5b40630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:32.079473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55481217-795d-42e7-88af-a112a5b40630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:32.080817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55481217-795d-42e7-88af-a112a5b40630 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:32.093225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 432/870] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:32.100973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daee73-5369-4384-92df-a948d74a3abd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:32.214067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace40556-ef98-4e60-bc17-d605b5ea2983 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.214702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace40556-ef98-4e60-bc17-d605b5ea2983 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.215192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace40556-ef98-4e60-bc17-d605b5ea2983 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.215467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daee73-5369-4384-92df-a948d74a3abd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:32.217801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 433/871] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:32.224234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c222b2-2bd5-4276-b79a-751080066d06 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.225217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c222b2-2bd5-4276-b79a-751080066d06 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.225767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c222b2-2bd5-4276-b79a-751080066d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.247531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-02c222b2-2bd5-4276-b79a-751080066d06 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:32.249589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-02c222b2-2bd5-4276-b79a-751080066d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:32.254742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731d34f-98b4-4a26-882a-16432a004dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:32.255674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d34f-98b4-4a26-882a-16432a004dfd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.256100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d34f-98b4-4a26-882a-16432a004dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.256522 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d34f-98b4-4a26-882a-16432a004dfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.263832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731d34f-98b4-4a26-882a-16432a004dfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:32.265561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731d34f-98b4-4a26-882a-16432a004dfd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-d731d34f-98b4-4a26-882a-16432a004dfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:32.281066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:32.281967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:32.283462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:32.283462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:32.283462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:32.283462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:32.283462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:32.283462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:32.283462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:32.283462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:32.284256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:32.286078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 439/872] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:32.291246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731d34f-98b4-4a26-882a-16432a004dfd None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:32.338974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:32.346042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 434/873] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:32.368881 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c222b2-2bd5-4276-b79a-751080066d06 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:32.414323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731d34f-98b4-4a26-882a-16432a004dfd None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:32.454837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4a42d-09e8-4a2f-a3e7-ad4ec64566b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:32.456530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a42d-09e8-4a2f-a3e7-ad4ec64566b3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.457276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a42d-09e8-4a2f-a3e7-ad4ec64566b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.458182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a42d-09e8-4a2f-a3e7-ad4ec64566b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.459605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4a42d-09e8-4a2f-a3e7-ad4ec64566b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:32.460277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4a42d-09e8-4a2f-a3e7-ad4ec64566b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:32.461736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4a42d-09e8-4a2f-a3e7-ad4ec64566b3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:32.475540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 440/874] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:32.477401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234f951-adbf-4948-8c30-e6062de5adb9 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.478249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234f951-adbf-4948-8c30-e6062de5adb9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.478807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234f951-adbf-4948-8c30-e6062de5adb9 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.480624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 441/875] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:32.481890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234f951-adbf-4948-8c30-e6062de5adb9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:32.484270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c222b2-2bd5-4276-b79a-751080066d06 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:32.525665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498594fb-fd7f-43fd-9bd0-24f08ad7cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:32.526493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498594fb-fd7f-43fd-9bd0-24f08ad7cf94 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.526773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498594fb-fd7f-43fd-9bd0-24f08ad7cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.527059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498594fb-fd7f-43fd-9bd0-24f08ad7cf94 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.527718 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498594fb-fd7f-43fd-9bd0-24f08ad7cf94 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:32.529107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498594fb-fd7f-43fd-9bd0-24f08ad7cf94 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-498594fb-fd7f-43fd-9bd0-24f08ad7cf94 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:32.542337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:32.543359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:32.549453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 435/876] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:32.550407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea357b-5f37-4fd2-afb9-e4eb3b3f175f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.550407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea357b-5f37-4fd2-afb9-e4eb3b3f175f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.550407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea357b-5f37-4fd2-afb9-e4eb3b3f175f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.565388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-18ea357b-5f37-4fd2-afb9-e4eb3b3f175f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:32.566638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-18ea357b-5f37-4fd2-afb9-e4eb3b3f175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:32.578567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:32.602023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234f951-adbf-4948-8c30-e6062de5adb9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:32.603682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:32.638173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfe65c-8154-4550-91b6-74155a177fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:32.638861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfe65c-8154-4550-91b6-74155a177fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.639115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfe65c-8154-4550-91b6-74155a177fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.639405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfe65c-8154-4550-91b6-74155a177fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.640270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfe65c-8154-4550-91b6-74155a177fb1 None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=63cf0ef7c80d4527ae14a6db28bbbc39) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:32.640592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfe65c-8154-4550-91b6-74155a177fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:32.641037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 436/877] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:32.641834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea357b-5f37-4fd2-afb9-e4eb3b3f175f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:32.645123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfe65c-8154-4550-91b6-74155a177fb1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:32.656606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 442/878] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:32 2022] GET /identity/v3/role_assignments?user.id=63cf0ef7c80d4527ae14a6db28bbbc39&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:32.676718 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfe65c-8154-4550-91b6-74155a177fb1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:32.753547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea357b-5f37-4fd2-afb9-e4eb3b3f175f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:32.791980 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8a4f-4ca7-436c-9a8f-fef278cb43e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:32.792780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8a4f-4ca7-436c-9a8f-fef278cb43e6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.793128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8a4f-4ca7-436c-9a8f-fef278cb43e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.793478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8a4f-4ca7-436c-9a8f-fef278cb43e6 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.794269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db8a4f-4ca7-436c-9a8f-fef278cb43e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:32.794678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db8a4f-4ca7-436c-9a8f-fef278cb43e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:32.796145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db8a4f-4ca7-436c-9a8f-fef278cb43e6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:32.802144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 437/879] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:32.806764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfe65c-8154-4550-91b6-74155a177fb1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:32.807454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8a4f-4ca7-436c-9a8f-fef278cb43e6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:32.823161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:32.848285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6e6e7-9480-4452-9f46-41322d4b2d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:32.849442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6e6e7-9480-4452-9f46-41322d4b2d64 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.849944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6e6e7-9480-4452-9f46-41322d4b2d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.850474 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6e6e7-9480-4452-9f46-41322d4b2d64 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.851403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6e6e7-9480-4452-9f46-41322d4b2d64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:32.853014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6e6e7-9480-4452-9f46-41322d4b2d64 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:32.870825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 443/880] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:59:32 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 21:59:32.944844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8a4f-4ca7-436c-9a8f-fef278cb43e6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:32.993620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1c5e-ef6f-45ee-a42a-a677a05020a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:32.994314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1c5e-ef6f-45ee-a42a-a677a05020a8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:32.994604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1c5e-ef6f-45ee-a42a-a677a05020a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:32.994891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1c5e-ef6f-45ee-a42a-a677a05020a8 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:32.995625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1c5e-ef6f-45ee-a42a-a677a05020a8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:32.995974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1c5e-ef6f-45ee-a42a-a677a05020a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:32.997389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1c5e-ef6f-45ee-a42a-a677a05020a8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:33.003804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 438/881] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:33.402265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7c6a-d28b-4713-b7fb-ed6a895d15e2 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:33.402756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7c6a-d28b-4713-b7fb-ed6a895d15e2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:33.402756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7c6a-d28b-4713-b7fb-ed6a895d15e2 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:33.404403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 444/882] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:33.410000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bd2cf-9e54-472a-bba7-debc0e5da8ec None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:33.410290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bd2cf-9e54-472a-bba7-debc0e5da8ec None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:33.410566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bd2cf-9e54-472a-bba7-debc0e5da8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:33.427639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-240bd2cf-9e54-472a-bba7-debc0e5da8ec None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:33.428874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-240bd2cf-9e54-472a-bba7-debc0e5da8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:33.497272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:33.503741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 439/883] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:33.533637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab7c6a-d28b-4713-b7fb-ed6a895d15e2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:33.561878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:33.641461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab7c6a-d28b-4713-b7fb-ed6a895d15e2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:33.677754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf36a9-2f55-418e-b856-8f5e2a2c2221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:33.678517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf36a9-2f55-418e-b856-8f5e2a2c2221 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:33.678801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf36a9-2f55-418e-b856-8f5e2a2c2221 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:33.679080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf36a9-2f55-418e-b856-8f5e2a2c2221 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:33.679735 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf36a9-2f55-418e-b856-8f5e2a2c2221 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:33.681176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf36a9-2f55-418e-b856-8f5e2a2c2221 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-dcaf36a9-2f55-418e-b856-8f5e2a2c2221 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:33.693447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:33.694440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 21:59:33.695284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:33.699731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 445/884] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:59:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:33.701087 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bd2cf-9e54-472a-bba7-debc0e5da8ec None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:33.805652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bd2cf-9e54-472a-bba7-debc0e5da8ec None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:33.841691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162a4c3-0211-4476-844d-7552cde31507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:33.842593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162a4c3-0211-4476-844d-7552cde31507 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:33.843059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162a4c3-0211-4476-844d-7552cde31507 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:33.843484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162a4c3-0211-4476-844d-7552cde31507 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:33.844381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162a4c3-0211-4476-844d-7552cde31507 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:33.845470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162a4c3-0211-4476-844d-7552cde31507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:33.847669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162a4c3-0211-4476-844d-7552cde31507 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:33.853086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 440/885] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:59:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:33.863918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf36a9-2f55-418e-b856-8f5e2a2c2221 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:33.951170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:33.963282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf36a9-2f55-418e-b856-8f5e2a2c2221 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:33.998351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdae614-b5df-4118-b07b-a1a9741a0320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:33.999037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae614-b5df-4118-b07b-a1a9741a0320 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:33.999320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae614-b5df-4118-b07b-a1a9741a0320 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:33.999598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae614-b5df-4118-b07b-a1a9741a0320 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:34.000360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdae614-b5df-4118-b07b-a1a9741a0320 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:34.000656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdae614-b5df-4118-b07b-a1a9741a0320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:34.002763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdae614-b5df-4118-b07b-a1a9741a0320 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:34.009041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 446/886] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:59:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:34.015045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162a4c3-0211-4476-844d-7552cde31507 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:34.082437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:34.125299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162a4c3-0211-4476-844d-7552cde31507 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:34.159453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bfd46-5ff8-402a-9561-6a60f31b0870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:34.160152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bfd46-5ff8-402a-9561-6a60f31b0870 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:34.160438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bfd46-5ff8-402a-9561-6a60f31b0870 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:34.160717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bfd46-5ff8-402a-9561-6a60f31b0870 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:34.161509 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bfd46-5ff8-402a-9561-6a60f31b0870 None admin] RBAC: Adding query filter params (interface=public, service_id=b86d701143ea4fbb96251a334e6edaf6, region_id=RegionOne) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:34.161821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bfd46-5ff8-402a-9561-6a60f31b0870 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:34.163175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bfd46-5ff8-402a-9561-6a60f31b0870 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:34.168939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 441/887] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 21:59:34 2022] GET /identity/v3/endpoints?service_id=b86d701143ea4fbb96251a334e6edaf6&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:34.174773 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdae614-b5df-4118-b07b-a1a9741a0320 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:34.280717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdae614-b5df-4118-b07b-a1a9741a0320 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:34.315531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd021dba-852c-47a1-810c-3b2b9f0c5c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:34.316225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd021dba-852c-47a1-810c-3b2b9f0c5c98 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:34.316506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd021dba-852c-47a1-810c-3b2b9f0c5c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:34.316782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd021dba-852c-47a1-810c-3b2b9f0c5c98 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:34.317517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd021dba-852c-47a1-810c-3b2b9f0c5c98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:34.319148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd021dba-852c-47a1-810c-3b2b9f0c5c98 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:34.332005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 447/888] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 21:59:34 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 21:59:34.950690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5b4c1-435f-43ca-b4f0-1f49f9ef6c80 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:34.951021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5b4c1-435f-43ca-b4f0-1f49f9ef6c80 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:34.951260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5b4c1-435f-43ca-b4f0-1f49f9ef6c80 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:34.952995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 442/889] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:34.958730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabb1d4-32c4-4d68-987e-8a7a74e4f2c2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:34.959207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabb1d4-32c4-4d68-987e-8a7a74e4f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:34.959296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabb1d4-32c4-4d68-987e-8a7a74e4f2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:34.977166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3aabb1d4-32c4-4d68-987e-8a7a74e4f2c2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:34.978363 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3aabb1d4-32c4-4d68-987e-8a7a74e4f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:34.993132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:34.999694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84214cb-e1c8-4b56-a65e-92f2a2867c92 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.000030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84214cb-e1c8-4b56-a65e-92f2a2867c92 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.000324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84214cb-e1c8-4b56-a65e-92f2a2867c92 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.002239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 443/890] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:35.007107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e81de2-d6ab-4644-8a9a-92a85db63cf2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.007399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e81de2-d6ab-4644-8a9a-92a85db63cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.007681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e81de2-d6ab-4644-8a9a-92a85db63cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.024396 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-56e81de2-d6ab-4644-8a9a-92a85db63cf2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:35.025714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-56e81de2-d6ab-4644-8a9a-92a85db63cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:35.062786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 448/891] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:35.088973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabb1d4-32c4-4d68-987e-8a7a74e4f2c2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.101867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 444/892] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:35.127800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e81de2-d6ab-4644-8a9a-92a85db63cf2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.190572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:35.204537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabb1d4-32c4-4d68-987e-8a7a74e4f2c2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:35.235130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e81de2-d6ab-4644-8a9a-92a85db63cf2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:35.241701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f972c-f346-4aae-a85a-3cecc3c89de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:35.242767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f972c-f346-4aae-a85a-3cecc3c89de9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.243204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f972c-f346-4aae-a85a-3cecc3c89de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.243592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f972c-f346-4aae-a85a-3cecc3c89de9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.255489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f972c-f346-4aae-a85a-3cecc3c89de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-827f972c-f346-4aae-a85a-3cecc3c89de9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:35.264268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:35.265189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:35.266034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 449/893] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:35.267384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec27c7-29c2-4f09-81fc-a93ee2808f2f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.267938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec27c7-29c2-4f09-81fc-a93ee2808f2f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.267938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec27c7-29c2-4f09-81fc-a93ee2808f2f None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.269324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 450/894] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:35.273907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec27c7-29c2-4f09-81fc-a93ee2808f2f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.278799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad87cb0-13a3-4152-87ae-cb6a5c1d358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:35.279616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad87cb0-13a3-4152-87ae-cb6a5c1d358d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.279916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad87cb0-13a3-4152-87ae-cb6a5c1d358d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.280226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad87cb0-13a3-4152-87ae-cb6a5c1d358d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.280890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad87cb0-13a3-4152-87ae-cb6a5c1d358d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:35.282315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad87cb0-13a3-4152-87ae-cb6a5c1d358d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:35.286009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-0ad87cb0-13a3-4152-87ae-cb6a5c1d358d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:35.294864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:35.295791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 21:59:35.296647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:35.301798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 445/895] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:35.302868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8792630-f0b2-4249-a464-0ab9b4c0c1bc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.303166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8792630-f0b2-4249-a464-0ab9b4c0c1bc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.303449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8792630-f0b2-4249-a464-0ab9b4c0c1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.320145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b8792630-f0b2-4249-a464-0ab9b4c0c1bc None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:35.321367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b8792630-f0b2-4249-a464-0ab9b4c0c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:35.388145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec27c7-29c2-4f09-81fc-a93ee2808f2f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:35.400085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 446/896] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:35.400085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8792630-f0b2-4249-a464-0ab9b4c0c1bc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.433426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f0d18-ff4e-49dc-bb23-423411357ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:35.434383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f0d18-ff4e-49dc-bb23-423411357ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.434837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f0d18-ff4e-49dc-bb23-423411357ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.435277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f0d18-ff4e-49dc-bb23-423411357ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.436210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f0d18-ff4e-49dc-bb23-423411357ba4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:35.436670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f0d18-ff4e-49dc-bb23-423411357ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:35.438084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f0d18-ff4e-49dc-bb23-423411357ba4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:35.446764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 451/897] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:35.447570 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f0d18-ff4e-49dc-bb23-423411357ba4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.463520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:35.516568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8792630-f0b2-4249-a464-0ab9b4c0c1bc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:35.527503 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:35.557410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179e7a-de3a-4da2-95d5-7ace1b4b63da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:35.558187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179e7a-de3a-4da2-95d5-7ace1b4b63da None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.558468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179e7a-de3a-4da2-95d5-7ace1b4b63da None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.558745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179e7a-de3a-4da2-95d5-7ace1b4b63da None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.559450 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08179e7a-de3a-4da2-95d5-7ace1b4b63da None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:35.559757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08179e7a-de3a-4da2-95d5-7ace1b4b63da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:35.560855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f0d18-ff4e-49dc-bb23-423411357ba4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:35.561138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08179e7a-de3a-4da2-95d5-7ace1b4b63da None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:35.570948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 447/898] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:35.570948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179e7a-de3a-4da2-95d5-7ace1b4b63da None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.601108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24401-3ab4-44e8-8382-38f53a5d3ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:35.601865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24401-3ab4-44e8-8382-38f53a5d3ae5 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.602156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24401-3ab4-44e8-8382-38f53a5d3ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.602438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24401-3ab4-44e8-8382-38f53a5d3ae5 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.603163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e24401-3ab4-44e8-8382-38f53a5d3ae5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:35.604590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e24401-3ab4-44e8-8382-38f53a5d3ae5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:35.618566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 452/899] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:59:35 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:35.624973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24401-3ab4-44e8-8382-38f53a5d3ae5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.686043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179e7a-de3a-4da2-95d5-7ace1b4b63da None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:35.707176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:35.735128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c44cbb-30a4-4e44-aa29-8ed94d6eefef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:35.736375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c44cbb-30a4-4e44-aa29-8ed94d6eefef None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.736888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c44cbb-30a4-4e44-aa29-8ed94d6eefef None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.737374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c44cbb-30a4-4e44-aa29-8ed94d6eefef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.745538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24401-3ab4-44e8-8382-38f53a5d3ae5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:35.750519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c44cbb-30a4-4e44-aa29-8ed94d6eefef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:35.753015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c44cbb-30a4-4e44-aa29-8ed94d6eefef None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-39c44cbb-30a4-4e44-aa29-8ed94d6eefef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:35.774732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:35.775689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:35.777033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:35.777033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:35.777033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:35.777033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:35.778987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:35.779359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 448/900] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:35.786976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c44cbb-30a4-4e44-aa29-8ed94d6eefef None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.788162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3538f5-b16e-4b74-8319-5ef087b79787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:35.788843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3538f5-b16e-4b74-8319-5ef087b79787 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.789135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3538f5-b16e-4b74-8319-5ef087b79787 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.789408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3538f5-b16e-4b74-8319-5ef087b79787 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.791026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3538f5-b16e-4b74-8319-5ef087b79787 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:35.791342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3538f5-b16e-4b74-8319-5ef087b79787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:35.792739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3538f5-b16e-4b74-8319-5ef087b79787 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:35.799981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 453/901] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:35.804425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3538f5-b16e-4b74-8319-5ef087b79787 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.907702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c44cbb-30a4-4e44-aa29-8ed94d6eefef None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:35.925193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3538f5-b16e-4b74-8319-5ef087b79787 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:35.945912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2620849-7f5a-4062-9be1-8408c4ca1be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:35.946577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2620849-7f5a-4062-9be1-8408c4ca1be8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.946859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2620849-7f5a-4062-9be1-8408c4ca1be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.947134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2620849-7f5a-4062-9be1-8408c4ca1be8 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.947853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2620849-7f5a-4062-9be1-8408c4ca1be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:35.948181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2620849-7f5a-4062-9be1-8408c4ca1be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:35.949547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2620849-7f5a-4062-9be1-8408c4ca1be8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:35.966968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 449/902] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:35.972535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2620849-7f5a-4062-9be1-8408c4ca1be8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:35.975291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34de03-a4f9-4a81-bf6c-7c537ab16b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:35.976063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34de03-a4f9-4a81-bf6c-7c537ab16b6f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:35.976415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34de03-a4f9-4a81-bf6c-7c537ab16b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:35.976957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34de03-a4f9-4a81-bf6c-7c537ab16b6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:35.978671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34de03-a4f9-4a81-bf6c-7c537ab16b6f None admin] RBAC: Adding query filter params (interface=public, service_id=1f317edca4a6445a96f75d7d0a146c9c, region_id=RegionOne) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:35.979085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34de03-a4f9-4a81-bf6c-7c537ab16b6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:35.980582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34de03-a4f9-4a81-bf6c-7c537ab16b6f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:35.988007 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 454/903] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/endpoints?service_id=1f317edca4a6445a96f75d7d0a146c9c&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:35.993016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34de03-a4f9-4a81-bf6c-7c537ab16b6f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:36.011453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:36.072950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:36.104710 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2620849-7f5a-4062-9be1-8408c4ca1be8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:36.120767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34de03-a4f9-4a81-bf6c-7c537ab16b6f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:36.150198 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1cad9-26b3-4ee7-b23d-3009324802ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:36.151120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1cad9-26b3-4ee7-b23d-3009324802ee None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:36.151503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1cad9-26b3-4ee7-b23d-3009324802ee None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:36.151875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1cad9-26b3-4ee7-b23d-3009324802ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:36.158485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba15706-5e9e-42b7-b0b0-f35e5da3c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:36.159375 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba15706-5e9e-42b7-b0b0-f35e5da3c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:36.159833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba15706-5e9e-42b7-b0b0-f35e5da3c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:36.160280 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba15706-5e9e-42b7-b0b0-f35e5da3c9b7 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:36.161031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1cad9-26b3-4ee7-b23d-3009324802ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:36.161277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba15706-5e9e-42b7-b0b0-f35e5da3c9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:36.162669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1cad9-26b3-4ee7-b23d-3009324802ee None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:36.162956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba15706-5e9e-42b7-b0b0-f35e5da3c9b7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:36.176180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 455/904] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b2d1cad9-26b3-4ee7-b23d-3009324802ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:36.180365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:36.181342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:36.182257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:36.186435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 450/905] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 21:59:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:36.189182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba15706-5e9e-42b7-b0b0-f35e5da3c9b7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:36.307337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba15706-5e9e-42b7-b0b0-f35e5da3c9b7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:36.335453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:36.348585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646a5b2-e49c-470a-8437-152dd499b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:36.349830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646a5b2-e49c-470a-8437-152dd499b813 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:36.350333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646a5b2-e49c-470a-8437-152dd499b813 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:36.350828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646a5b2-e49c-470a-8437-152dd499b813 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:36.351881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646a5b2-e49c-470a-8437-152dd499b813 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:36.352427 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646a5b2-e49c-470a-8437-152dd499b813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:36.354059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646a5b2-e49c-470a-8437-152dd499b813 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:36.374568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 456/906] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 21:59:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:36.380990 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1cad9-26b3-4ee7-b23d-3009324802ee None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:36.430026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdcfd5-1dc9-4871-ad7f-894a6c68f010 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:36.430550 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdcfd5-1dc9-4871-ad7f-894a6c68f010 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:36.430951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdcfd5-1dc9-4871-ad7f-894a6c68f010 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:36.432815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 457/907] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:36.437947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc44a-3a11-487c-a13d-7c2daf9505bb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:36.438881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc44a-3a11-487c-a13d-7c2daf9505bb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:36.439262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc44a-3a11-487c-a13d-7c2daf9505bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:36.458319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a7dfc44a-3a11-487c-a13d-7c2daf9505bb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:36.459797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a7dfc44a-3a11-487c-a13d-7c2daf9505bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:36.477758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:36.494772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1cad9-26b3-4ee7-b23d-3009324802ee None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:36.529766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11b76c-104a-4f82-b984-6eb98530a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:36.530409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11b76c-104a-4f82-b984-6eb98530a065 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:36.530696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11b76c-104a-4f82-b984-6eb98530a065 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:36.530971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11b76c-104a-4f82-b984-6eb98530a065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:36.544017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 458/908] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:36.563962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc44a-3a11-487c-a13d-7c2daf9505bb None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:36.604828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11b76c-104a-4f82-b984-6eb98530a065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:36.606135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11b76c-104a-4f82-b984-6eb98530a065 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:36.685448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc44a-3a11-487c-a13d-7c2daf9505bb None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:36.695651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:36.699100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:36.718275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 451/909] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 21:59:36.720511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11b76c-104a-4f82-b984-6eb98530a065 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:36.726338 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d07ba-a9ee-4019-895b-aa9a78257781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:36.727387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d07ba-a9ee-4019-895b-aa9a78257781 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:36.727861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d07ba-a9ee-4019-895b-aa9a78257781 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:36.728369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d07ba-a9ee-4019-895b-aa9a78257781 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:36.729368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d07ba-a9ee-4019-895b-aa9a78257781 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:36.731014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d07ba-a9ee-4019-895b-aa9a78257781 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-db5d07ba-a9ee-4019-895b-aa9a78257781 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:36.744553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:36.745571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 21:59:36.746411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:36.753919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 459/910] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:59:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:36.755689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d07ba-a9ee-4019-895b-aa9a78257781 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:36.827204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11b76c-104a-4f82-b984-6eb98530a065 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:36.864259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d07ba-a9ee-4019-895b-aa9a78257781 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:36.865120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d236-efa5-4602-af2d-35c8b19c564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:36.866024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d236-efa5-4602-af2d-35c8b19c564e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:36.866506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d236-efa5-4602-af2d-35c8b19c564e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:36.866878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d236-efa5-4602-af2d-35c8b19c564e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:36.879209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76d236-efa5-4602-af2d-35c8b19c564e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:36.880998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76d236-efa5-4602-af2d-35c8b19c564e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-3d76d236-efa5-4602-af2d-35c8b19c564e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:36.902109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:36.903315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:36.904418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:36.904418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:36.904418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:36.904418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:36.908144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c09b4b-3e63-401e-adea-dad65dbe2b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:36.909051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09b4b-3e63-401e-adea-dad65dbe2b14 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:36.909500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09b4b-3e63-401e-adea-dad65dbe2b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:36.909951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09b4b-3e63-401e-adea-dad65dbe2b14 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:36.910294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 452/911] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:36.911020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c09b4b-3e63-401e-adea-dad65dbe2b14 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:36.911514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c09b4b-3e63-401e-adea-dad65dbe2b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:36.911617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d236-efa5-4602-af2d-35c8b19c564e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:36.913293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c09b4b-3e63-401e-adea-dad65dbe2b14 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:36.924905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 460/912] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:59:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:36.926227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c09b4b-3e63-401e-adea-dad65dbe2b14 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:36.953634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:36.977610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:37.027359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d236-efa5-4602-af2d-35c8b19c564e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:37.043073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c09b4b-3e63-401e-adea-dad65dbe2b14 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:37.064549 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b89d6-6917-42c9-b8fa-68c2f0f13e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:37.065495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b89d6-6917-42c9-b8fa-68c2f0f13e07 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:37.065965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b89d6-6917-42c9-b8fa-68c2f0f13e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:37.066428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b89d6-6917-42c9-b8fa-68c2f0f13e07 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:37.067423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b89d6-6917-42c9-b8fa-68c2f0f13e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:37.067944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b89d6-6917-42c9-b8fa-68c2f0f13e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:37.069516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b89d6-6917-42c9-b8fa-68c2f0f13e07 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:37.079411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38237f8-bbf9-4f21-865a-5f3701f6e0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:37.080119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38237f8-bbf9-4f21-865a-5f3701f6e0df None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:37.080512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38237f8-bbf9-4f21-865a-5f3701f6e0df None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:37.080950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38237f8-bbf9-4f21-865a-5f3701f6e0df None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:37.081989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38237f8-bbf9-4f21-865a-5f3701f6e0df None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:37.082372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38237f8-bbf9-4f21-865a-5f3701f6e0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:37.084007 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38237f8-bbf9-4f21-865a-5f3701f6e0df None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:37.087750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 453/913] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:37.089208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b89d6-6917-42c9-b8fa-68c2f0f13e07 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:37.093672 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 461/914] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 21:59:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:37.095190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38237f8-bbf9-4f21-865a-5f3701f6e0df None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:37.197713 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:37.203256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38237f8-bbf9-4f21-865a-5f3701f6e0df None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:37.204507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b89d6-6917-42c9-b8fa-68c2f0f13e07 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:37.205490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:37.240354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3f865-f4bb-47f8-9da6-9c07a2f08a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:37.241292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3f865-f4bb-47f8-9da6-9c07a2f08a0b None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:37.241731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3f865-f4bb-47f8-9da6-9c07a2f08a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:37.242184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3f865-f4bb-47f8-9da6-9c07a2f08a0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:37.243087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3f865-f4bb-47f8-9da6-9c07a2f08a0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:37.244466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fdb1f-1e4e-4ebc-bee2-a788fba827c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:37.244847 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3f865-f4bb-47f8-9da6-9c07a2f08a0b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:37.245390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fdb1f-1e4e-4ebc-bee2-a788fba827c8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:37.245753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fdb1f-1e4e-4ebc-bee2-a788fba827c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:37.246104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fdb1f-1e4e-4ebc-bee2-a788fba827c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:37.254197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fdb1f-1e4e-4ebc-bee2-a788fba827c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:37.255998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fdb1f-1e4e-4ebc-bee2-a788fba827c8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:37.272314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 462/915] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 21:59:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-ef1fdb1f-1e4e-4ebc-bee2-a788fba827c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:37.273004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:37.273919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:37.274946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:37.274946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:37.274946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:37.274946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:37.274946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:37.274946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:37.274946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:37.274946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:37.278813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 454/916] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:37.280261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3f865-f4bb-47f8-9da6-9c07a2f08a0b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:37.404558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3f865-f4bb-47f8-9da6-9c07a2f08a0b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:37.446543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e84a89-a3cc-4486-9e35-714088fa2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:37.447210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e84a89-a3cc-4486-9e35-714088fa2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:37.447493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e84a89-a3cc-4486-9e35-714088fa2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:37.447767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e84a89-a3cc-4486-9e35-714088fa2ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:37.448595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e84a89-a3cc-4486-9e35-714088fa2ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:37.448905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e84a89-a3cc-4486-9e35-714088fa2ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:37.450402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e84a89-a3cc-4486-9e35-714088fa2ba1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:37.467974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 463/917] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:37.470320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fdb1f-1e4e-4ebc-bee2-a788fba827c8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:37.580707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fdb1f-1e4e-4ebc-bee2-a788fba827c8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:37.619912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1ae59-44ba-468f-98ec-f6179c6dfb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:37.620592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1ae59-44ba-468f-98ec-f6179c6dfb91 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:37.620880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1ae59-44ba-468f-98ec-f6179c6dfb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:37.621166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1ae59-44ba-468f-98ec-f6179c6dfb91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:37.622008 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1ae59-44ba-468f-98ec-f6179c6dfb91 None admin] RBAC: Adding query filter params (role.id=7670d309329c458c8cdf908d84bd2fd6, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=63cf0ef7c80d4527ae14a6db28bbbc39) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:37.622325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1ae59-44ba-468f-98ec-f6179c6dfb91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:37.623760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1ae59-44ba-468f-98ec-f6179c6dfb91 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:37.630698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 455/918] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:37 2022] GET /identity/v3/role_assignments?user.id=63cf0ef7c80d4527ae14a6db28bbbc39&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=7670d309329c458c8cdf908d84bd2fd6 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:37.878342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9ef2-cac8-43b5-8742-9a3c7ff067a9 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:37.878726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9ef2-cac8-43b5-8742-9a3c7ff067a9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:37.878941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9ef2-cac8-43b5-8742-9a3c7ff067a9 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:37.880729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 464/919] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:37.886336 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a634606-8638-462b-98ba-cb9e23b816e7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:37.886634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a634606-8638-462b-98ba-cb9e23b816e7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:37.886920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a634606-8638-462b-98ba-cb9e23b816e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:37.905139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5a634606-8638-462b-98ba-cb9e23b816e7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:37.906344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5a634606-8638-462b-98ba-cb9e23b816e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:37.924158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:37.988758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 456/920] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:38.011573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d9ef2-cac8-43b5-8742-9a3c7ff067a9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:38.028510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:38.132609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d9ef2-cac8-43b5-8742-9a3c7ff067a9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:38.169455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e11b34-cf8f-4d91-ad6f-6924f69bdd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:38.170635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e11b34-cf8f-4d91-ad6f-6924f69bdd9d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:38.171127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e11b34-cf8f-4d91-ad6f-6924f69bdd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:38.171616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e11b34-cf8f-4d91-ad6f-6924f69bdd9d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:38.173065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e11b34-cf8f-4d91-ad6f-6924f69bdd9d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:38.174768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e11b34-cf8f-4d91-ad6f-6924f69bdd9d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-84e11b34-cf8f-4d91-ad6f-6924f69bdd9d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:38.187397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:38.188590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:38.189461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:38.196010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 465/921] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:38.200991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a634606-8638-462b-98ba-cb9e23b816e7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:38.298345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b55c-745f-43b7-a493-8e9ac2907340 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:38.298999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b55c-745f-43b7-a493-8e9ac2907340 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:38.299481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b55c-745f-43b7-a493-8e9ac2907340 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:38.301465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 466/922] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:38.306372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf51e2-470d-4188-a1c3-b45c017c712e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:38.306667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf51e2-470d-4188-a1c3-b45c017c712e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:38.306951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf51e2-470d-4188-a1c3-b45c017c712e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:38.317691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a634606-8638-462b-98ba-cb9e23b816e7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:38.324485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0bcf51e2-470d-4188-a1c3-b45c017c712e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:38.325681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0bcf51e2-470d-4188-a1c3-b45c017c712e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:38.366073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4baff4-36b8-43c6-9f0b-d595f6a4ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:38.367142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4baff4-36b8-43c6-9f0b-d595f6a4ef2e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:38.367870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4baff4-36b8-43c6-9f0b-d595f6a4ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:38.369409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4baff4-36b8-43c6-9f0b-d595f6a4ef2e None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:38.370337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4baff4-36b8-43c6-9f0b-d595f6a4ef2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:38.370851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4baff4-36b8-43c6-9f0b-d595f6a4ef2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:38.372452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4baff4-36b8-43c6-9f0b-d595f6a4ef2e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:38.385551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 457/923] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:38.387800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4baff4-36b8-43c6-9f0b-d595f6a4ef2e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:38.410589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:38.418839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 467/924] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:38.436513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf51e2-470d-4188-a1c3-b45c017c712e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:38.447334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:38.514793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4baff4-36b8-43c6-9f0b-d595f6a4ef2e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:38.549479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf51e2-470d-4188-a1c3-b45c017c712e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:38.551967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d7e77-25a7-445e-a197-f2d0e869dcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:38.552840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d7e77-25a7-445e-a197-f2d0e869dcac None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:38.553314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d7e77-25a7-445e-a197-f2d0e869dcac None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:38.553778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d7e77-25a7-445e-a197-f2d0e869dcac None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:38.554686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d7e77-25a7-445e-a197-f2d0e869dcac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:38.555172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d7e77-25a7-445e-a197-f2d0e869dcac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:38.556736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d7e77-25a7-445e-a197-f2d0e869dcac None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:38.568472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 458/925] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:38.570223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d7e77-25a7-445e-a197-f2d0e869dcac None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:38.593459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c1e96-66f2-4759-8804-77b5b27936f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:38.594611 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c1e96-66f2-4759-8804-77b5b27936f6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:38.595025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c1e96-66f2-4759-8804-77b5b27936f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:38.595370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c1e96-66f2-4759-8804-77b5b27936f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:38.596316 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c1e96-66f2-4759-8804-77b5b27936f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:38.597930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c1e96-66f2-4759-8804-77b5b27936f6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b31c1e96-66f2-4759-8804-77b5b27936f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:38.617344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:38.618354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 21:59:38.619172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:38.621521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 468/926] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jul 13 21:59:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:38.627737 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c1e96-66f2-4759-8804-77b5b27936f6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:38.670531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:38.697991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d7e77-25a7-445e-a197-f2d0e869dcac None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:38.724328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:38.741113 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7977-69fd-47a3-aba7-6fdf88152cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:38.741846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7977-69fd-47a3-aba7-6fdf88152cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:38.742074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7977-69fd-47a3-aba7-6fdf88152cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:38.742357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7977-69fd-47a3-aba7-6fdf88152cf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:38.743439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7977-69fd-47a3-aba7-6fdf88152cf9 None admin] RBAC: Adding query filter params (interface=public, service_id=25f6f16d08824b5289e4400c2c3141e1, region_id=RegionOne) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:38.743764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7977-69fd-47a3-aba7-6fdf88152cf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:38.745331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7977-69fd-47a3-aba7-6fdf88152cf9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:38.757284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 459/927] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 21:59:38 2022] GET /identity/v3/endpoints?service_id=25f6f16d08824b5289e4400c2c3141e1&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:38.759468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7977-69fd-47a3-aba7-6fdf88152cf9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:38.769855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c1e96-66f2-4759-8804-77b5b27936f6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:38.833257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f62e7-c287-41e3-bd5f-0dc96d9abe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:38.833965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f62e7-c287-41e3-bd5f-0dc96d9abe8e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:38.834253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f62e7-c287-41e3-bd5f-0dc96d9abe8e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:38.834535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f62e7-c287-41e3-bd5f-0dc96d9abe8e None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:38.835251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f62e7-c287-41e3-bd5f-0dc96d9abe8e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:38.835561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f62e7-c287-41e3-bd5f-0dc96d9abe8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:38.836958 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f62e7-c287-41e3-bd5f-0dc96d9abe8e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:38.843874 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 469/928] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:38.849066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f62e7-c287-41e3-bd5f-0dc96d9abe8e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:38.933820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7977-69fd-47a3-aba7-6fdf88152cf9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:38.995629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f62e7-c287-41e3-bd5f-0dc96d9abe8e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:39.009632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7ac0-b841-4b12-8abc-124c599cd2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:39.010325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7ac0-b841-4b12-8abc-124c599cd2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:39.010869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7ac0-b841-4b12-8abc-124c599cd2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:39.010869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7ac0-b841-4b12-8abc-124c599cd2a7 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:39.011568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7ac0-b841-4b12-8abc-124c599cd2a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:39.012977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7ac0-b841-4b12-8abc-124c599cd2a7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:39.031983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 460/929] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 21:59:38 2022] GET /identity/v3/services => generated 1497 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 21:59:39.049787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4e55c-db4d-49c4-9c50-f83e7a3557bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:39.051156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4e55c-db4d-49c4-9c50-f83e7a3557bd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:39.051657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4e55c-db4d-49c4-9c50-f83e7a3557bd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:39.052174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4e55c-db4d-49c4-9c50-f83e7a3557bd None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:39.053102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4e55c-db4d-49c4-9c50-f83e7a3557bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:39.053644 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4e55c-db4d-49c4-9c50-f83e7a3557bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:39.055304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4e55c-db4d-49c4-9c50-f83e7a3557bd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:39.069184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 470/930] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:39.072323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:39.074621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7ac0-b841-4b12-8abc-124c599cd2a7 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:39.087145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:39.218988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7ac0-b841-4b12-8abc-124c599cd2a7 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:39.261400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159618c-0f26-471a-a536-7401cee742f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:39.262238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159618c-0f26-471a-a536-7401cee742f0 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:39.262619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159618c-0f26-471a-a536-7401cee742f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:39.262993 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159618c-0f26-471a-a536-7401cee742f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:39.263841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159618c-0f26-471a-a536-7401cee742f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:39.265361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159618c-0f26-471a-a536-7401cee742f0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:39.295925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 461/931] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 21:59:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:39.601997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b65d2-299e-41cb-a810-2150de27c4e5 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:39.602379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b65d2-299e-41cb-a810-2150de27c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:39.602583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b65d2-299e-41cb-a810-2150de27c4e5 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:39.604093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 471/932] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:39.609393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef1d3-61a5-423f-baf3-dde8e477f428 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:39.609687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef1d3-61a5-423f-baf3-dde8e477f428 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:39.610508 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef1d3-61a5-423f-baf3-dde8e477f428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:39.627559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-66aef1d3-61a5-423f-baf3-dde8e477f428 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:39.628779 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-66aef1d3-61a5-423f-baf3-dde8e477f428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:39.688489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:39.705517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 462/933] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:39.729830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b65d2-299e-41cb-a810-2150de27c4e5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:39.749490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b7ba3-4821-4af6-9a5b-8eea3302a32a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:39.749794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b7ba3-4821-4af6-9a5b-8eea3302a32a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:39.750052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b7ba3-4821-4af6-9a5b-8eea3302a32a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:39.751744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 463/934] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:39.757700 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6d4d-fa83-4859-877b-e9582bb88ba4 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:39.758097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6d4d-fa83-4859-877b-e9582bb88ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:39.758470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6d4d-fa83-4859-877b-e9582bb88ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:39.779785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4c1c6d4d-fa83-4859-877b-e9582bb88ba4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:39.781016 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4c1c6d4d-fa83-4859-877b-e9582bb88ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:39.857259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b65d2-299e-41cb-a810-2150de27c4e5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:39.874749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 464/935] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:39.893202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6d4d-fa83-4859-877b-e9582bb88ba4 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:39.904808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:39.906238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:39.906720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:39.907263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:39.908386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:39.910109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:39.911792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING keystone.server.flask.common [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 21:59:39.936453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.sql.core [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 21:59:39.936453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 21:59:39.936453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [parameters: {'id': '406968d850ad472791501cb688e8a0e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 21:59:39.936453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80411) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 406968d850ad472791501cb688e8a0e9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 406968d850ad472791501cb688e8a0e9. Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application conn.query(q) Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 21:59:39.956105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application result.read() Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 13 21:59:39.957239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application next(self.gen) Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application yield resource Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application next(self.gen) Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise self.value Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application session.commit() Jul 13 21:59:39.958219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.session.flush() Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application compat.raise_( Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 21:59:39.959187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 21:59:39.960097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application conn.query(q) Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application result.read() Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 21:59:39.960882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [parameters: {'id': '406968d850ad472791501cb688e8a0e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:39.961728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:39.962514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:39.963400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:39.963400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 13 21:59:39.963400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 13 21:59:39.963400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:39.963400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:39.963400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 13 21:59:39.963400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 13 21:59:39.963400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 406968d850ad472791501cb688e8a0e9. Jul 13 21:59:39.963400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:39.971388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 472/936] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Jul 13 21:59:39 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:39.973007 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:40.002089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6d4d-fa83-4859-877b-e9582bb88ba4 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:40.019919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:40.037964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a765-3b90-4653-ad16-ac3d02e7459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:40.038869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a765-3b90-4653-ad16-ac3d02e7459b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:40.039256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a765-3b90-4653-ad16-ac3d02e7459b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:40.039630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a765-3b90-4653-ad16-ac3d02e7459b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:40.042704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:40.050905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a765-3b90-4653-ad16-ac3d02e7459b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-04a0a765-3b90-4653-ad16-ac3d02e7459b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:40.059332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:40.060543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:40.061415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:40.062076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 465/937] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 21:59:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:40.068134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a765-3b90-4653-ad16-ac3d02e7459b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:40.098104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad6f67-95f9-44d1-aee6-eab80f0c46d7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:40.138801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ed273-3c01-4d7a-9288-040c75f64ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:40.140067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ed273-3c01-4d7a-9288-040c75f64ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:40.140531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ed273-3c01-4d7a-9288-040c75f64ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:40.141006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ed273-3c01-4d7a-9288-040c75f64ae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:40.148652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ed273-3c01-4d7a-9288-040c75f64ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:40.150623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ed273-3c01-4d7a-9288-040c75f64ae0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e33ed273-3c01-4d7a-9288-040c75f64ae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:40.166244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:40.167152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:40.168064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:40.168064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:40.168064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:40.168064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:40.168064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:40.168064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:40.168064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:40.168064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:40.175348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a765-3b90-4653-ad16-ac3d02e7459b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:40.175720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 473/938] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:40.176878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ed273-3c01-4d7a-9288-040c75f64ae0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:40.210567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5341b-0dcb-4a1d-a556-0ffda765be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:40.211340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5341b-0dcb-4a1d-a556-0ffda765be2a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:40.211631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5341b-0dcb-4a1d-a556-0ffda765be2a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:40.211932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5341b-0dcb-4a1d-a556-0ffda765be2a None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:40.212897 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5341b-0dcb-4a1d-a556-0ffda765be2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:40.213087 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5341b-0dcb-4a1d-a556-0ffda765be2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:40.214451 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5341b-0dcb-4a1d-a556-0ffda765be2a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:40.228360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 466/939] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 21:59:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:40.229325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5341b-0dcb-4a1d-a556-0ffda765be2a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:40.273147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:40.293079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ed273-3c01-4d7a-9288-040c75f64ae0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:40.311187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:40.332605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30abd69-a6aa-4379-b4b1-c0b49be4fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:40.333706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30abd69-a6aa-4379-b4b1-c0b49be4fc8f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:40.334271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30abd69-a6aa-4379-b4b1-c0b49be4fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:40.334765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30abd69-a6aa-4379-b4b1-c0b49be4fc8f None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:40.335729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30abd69-a6aa-4379-b4b1-c0b49be4fc8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:40.336270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30abd69-a6aa-4379-b4b1-c0b49be4fc8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:40.336702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5341b-0dcb-4a1d-a556-0ffda765be2a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:40.338250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30abd69-a6aa-4379-b4b1-c0b49be4fc8f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:40.368470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 474/940] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:40.373965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c4c7e-1402-4cc6-bc40-19ce7b7c4930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:40.374785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c4c7e-1402-4cc6-bc40-19ce7b7c4930 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:40.375069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c4c7e-1402-4cc6-bc40-19ce7b7c4930 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:40.375348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c4c7e-1402-4cc6-bc40-19ce7b7c4930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:40.388079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c4c7e-1402-4cc6-bc40-19ce7b7c4930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:40.389556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c4c7e-1402-4cc6-bc40-19ce7b7c4930 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e96c4c7e-1402-4cc6-bc40-19ce7b7c4930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:40.409068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:40.410061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:40.410949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:40.410949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:40.410949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:40.410949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:40.410949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 467/941] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:40.416417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30abd69-a6aa-4379-b4b1-c0b49be4fc8f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:40.530484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30abd69-a6aa-4379-b4b1-c0b49be4fc8f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:40.574116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e651f4e-a4d4-4c70-a9e7-dd861d3034a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:40.575187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e651f4e-a4d4-4c70-a9e7-dd861d3034a9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:40.575676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e651f4e-a4d4-4c70-a9e7-dd861d3034a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:40.576206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e651f4e-a4d4-4c70-a9e7-dd861d3034a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:40.577151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e651f4e-a4d4-4c70-a9e7-dd861d3034a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:40.577672 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e651f4e-a4d4-4c70-a9e7-dd861d3034a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:40.579102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e651f4e-a4d4-4c70-a9e7-dd861d3034a9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:40.591681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 475/942] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:40.597232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c4c7e-1402-4cc6-bc40-19ce7b7c4930 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:40.695160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:40.706145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c4c7e-1402-4cc6-bc40-19ce7b7c4930 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:40.740900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca02d-8821-40d8-b888-da8c5c2c316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:40.741726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca02d-8821-40d8-b888-da8c5c2c316b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:40.742006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca02d-8821-40d8-b888-da8c5c2c316b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:40.742282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca02d-8821-40d8-b888-da8c5c2c316b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:40.749886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca02d-8821-40d8-b888-da8c5c2c316b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:40.751840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca02d-8821-40d8-b888-da8c5c2c316b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-863ca02d-8821-40d8-b888-da8c5c2c316b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:40.766709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:40.767727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:40.769584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 468/943] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 21:59:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:40.774063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e651f4e-a4d4-4c70-a9e7-dd861d3034a9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:40.813543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:40.886276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e651f4e-a4d4-4c70-a9e7-dd861d3034a9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:40.921759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc4798-753f-4f05-bf2e-cde82add457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:40.923004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4798-753f-4f05-bf2e-cde82add457d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:40.923291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4798-753f-4f05-bf2e-cde82add457d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:40.923569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4798-753f-4f05-bf2e-cde82add457d None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:40.924617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc4798-753f-4f05-bf2e-cde82add457d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:40.924928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc4798-753f-4f05-bf2e-cde82add457d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:40.926347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc4798-753f-4f05-bf2e-cde82add457d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:40.944955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 476/944] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 21:59:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:40.953023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca02d-8821-40d8-b888-da8c5c2c316b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:41.063719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca02d-8821-40d8-b888-da8c5c2c316b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:41.098879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2751f-f627-4d9d-9a11-f37380353546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:41.099671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2751f-f627-4d9d-9a11-f37380353546 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.099990 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2751f-f627-4d9d-9a11-f37380353546 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.100273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2751f-f627-4d9d-9a11-f37380353546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.112723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2751f-f627-4d9d-9a11-f37380353546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:41.114237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2751f-f627-4d9d-9a11-f37380353546 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-dea2751f-f627-4d9d-9a11-f37380353546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:41.132281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:41.133220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:41.134101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:41.134101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:41.134101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:41.134101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:41.134101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 469/945] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:41.140125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc4798-753f-4f05-bf2e-cde82add457d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:41.237574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:41.245894 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc4798-753f-4f05-bf2e-cde82add457d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:41.287374 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03aca9-bf2f-4c3b-a7b8-45c7359dbb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:41.288159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03aca9-bf2f-4c3b-a7b8-45c7359dbb7e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.288515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03aca9-bf2f-4c3b-a7b8-45c7359dbb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.288864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03aca9-bf2f-4c3b-a7b8-45c7359dbb7e None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.289656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03aca9-bf2f-4c3b-a7b8-45c7359dbb7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:41.290032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03aca9-bf2f-4c3b-a7b8-45c7359dbb7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:41.291452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03aca9-bf2f-4c3b-a7b8-45c7359dbb7e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:41.303447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 477/946] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:41.308976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2751f-f627-4d9d-9a11-f37380353546 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:41.312992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:41.321118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1020f-0c05-4709-bbc4-13bac58ccaf1 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.322344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1020f-0c05-4709-bbc4-13bac58ccaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.322907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1020f-0c05-4709-bbc4-13bac58ccaf1 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.325308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 478/947] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:41.330371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43490259-4306-4487-a55b-41cee1e3f708 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.330758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43490259-4306-4487-a55b-41cee1e3f708 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.331566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43490259-4306-4487-a55b-41cee1e3f708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.354781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-43490259-4306-4487-a55b-41cee1e3f708 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:41.356434 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-43490259-4306-4487-a55b-41cee1e3f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:41.423933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2751f-f627-4d9d-9a11-f37380353546 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:41.453413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 479/948] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:41.465106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9e8f0-3d69-4993-898e-47806ed77a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:41.465987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e8f0-3d69-4993-898e-47806ed77a32 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.466369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e8f0-3d69-4993-898e-47806ed77a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.466719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e8f0-3d69-4993-898e-47806ed77a32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.474253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9e8f0-3d69-4993-898e-47806ed77a32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:41.475780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9e8f0-3d69-4993-898e-47806ed77a32 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:41.477413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43490259-4306-4487-a55b-41cee1e3f708 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b6f9e8f0-3d69-4993-898e-47806ed77a32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:41.495883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:41.497005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:41.498069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:41.498069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:41.498069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:41.498069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:41.498069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:41.498069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:41.498069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:41.498069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:41.500307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 470/949] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:41.506705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9e8f0-3d69-4993-898e-47806ed77a32 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:41.571271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:41.575210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:41.589445 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43490259-4306-4487-a55b-41cee1e3f708 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:41.619129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9e8f0-3d69-4993-898e-47806ed77a32 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:41.629769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8da88-ae24-4482-ae47-bada37aac342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:41.630594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8da88-ae24-4482-ae47-bada37aac342 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.631192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8da88-ae24-4482-ae47-bada37aac342 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.631192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8da88-ae24-4482-ae47-bada37aac342 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.631815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8da88-ae24-4482-ae47-bada37aac342 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:41.633262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8da88-ae24-4482-ae47-bada37aac342 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-95b8da88-ae24-4482-ae47-bada37aac342 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:41.646120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:41.647359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:41.653296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 480/950] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:41.654264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6cde2-4096-4b5f-bb24-88b3c385c64b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.654264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6cde2-4096-4b5f-bb24-88b3c385c64b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.654264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6cde2-4096-4b5f-bb24-88b3c385c64b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.654264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 481/951] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:41.655155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6cde2-4096-4b5f-bb24-88b3c385c64b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:41.671885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b92a3-6dc3-4890-be9b-a872b106ee0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:41.673516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b92a3-6dc3-4890-be9b-a872b106ee0e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.673804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b92a3-6dc3-4890-be9b-a872b106ee0e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.674084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b92a3-6dc3-4890-be9b-a872b106ee0e None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.674876 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b92a3-6dc3-4890-be9b-a872b106ee0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:41.675185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b92a3-6dc3-4890-be9b-a872b106ee0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:41.676636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b92a3-6dc3-4890-be9b-a872b106ee0e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:41.688923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 471/952] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:41.690151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbac109-3adf-4762-88c5-77463003cd05 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.690428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbac109-3adf-4762-88c5-77463003cd05 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.690707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbac109-3adf-4762-88c5-77463003cd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.707453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1cbac109-3adf-4762-88c5-77463003cd05 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:41.708662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1cbac109-3adf-4762-88c5-77463003cd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:41.777485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 472/953] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:41.777791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6cde2-4096-4b5f-bb24-88b3c385c64b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:41.778480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbac109-3adf-4762-88c5-77463003cd05 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:41.818288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53426e-9fa2-4258-83c8-c1cea3279867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:41.819224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53426e-9fa2-4258-83c8-c1cea3279867 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.819626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53426e-9fa2-4258-83c8-c1cea3279867 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.820045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53426e-9fa2-4258-83c8-c1cea3279867 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.820858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53426e-9fa2-4258-83c8-c1cea3279867 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:41.821247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53426e-9fa2-4258-83c8-c1cea3279867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:41.822677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53426e-9fa2-4258-83c8-c1cea3279867 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:41.832811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 482/954] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:41.832811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53426e-9fa2-4258-83c8-c1cea3279867 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:41.849509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:41.849678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:41.906435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbac109-3adf-4762-88c5-77463003cd05 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:41.942498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53426e-9fa2-4258-83c8-c1cea3279867 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:41.944406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09a94-1b18-46d4-a1ec-224039f559c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:41.945366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09a94-1b18-46d4-a1ec-224039f559c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.945729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09a94-1b18-46d4-a1ec-224039f559c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.946067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09a94-1b18-46d4-a1ec-224039f559c9 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/63cf0ef7c80d4527ae14a6db28bbbc39/roles/7670d309329c458c8cdf908d84bd2fd6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.948373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09a94-1b18-46d4-a1ec-224039f559c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=63cf0ef7c80d4527ae14a6db28bbbc39, role_id=7670d309329c458c8cdf908d84bd2fd6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:41.949884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09a94-1b18-46d4-a1ec-224039f559c9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:41.964864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 473/955] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:41 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/63cf0ef7c80d4527ae14a6db28bbbc39/roles/7670d309329c458c8cdf908d84bd2fd6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 21:59:41.965907 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09a94-1b18-46d4-a1ec-224039f559c9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:41.986912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ec829-625e-43c3-ab9d-42ca32e026fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:41.987886 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ec829-625e-43c3-ab9d-42ca32e026fa None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:41.988279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ec829-625e-43c3-ab9d-42ca32e026fa None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:41.988630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ec829-625e-43c3-ab9d-42ca32e026fa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:41.989536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ec829-625e-43c3-ab9d-42ca32e026fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:41.991336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ec829-625e-43c3-ab9d-42ca32e026fa None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ca3ec829-625e-43c3-ab9d-42ca32e026fa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:42.007016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:42.008452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 21:59:42.009615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:42.011122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 483/956] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:42.018508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ec829-625e-43c3-ab9d-42ca32e026fa None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:42.128823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09a94-1b18-46d4-a1ec-224039f559c9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:42.130143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:42.148317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:42.161192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ec829-625e-43c3-ab9d-42ca32e026fa None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:42.173230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64e8b-557f-47bd-8881-70c6ceed4900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:42.173976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64e8b-557f-47bd-8881-70c6ceed4900 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:42.174304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64e8b-557f-47bd-8881-70c6ceed4900 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:42.174588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64e8b-557f-47bd-8881-70c6ceed4900 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:42.175315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e64e8b-557f-47bd-8881-70c6ceed4900 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:42.175633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e64e8b-557f-47bd-8881-70c6ceed4900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:42.177791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e64e8b-557f-47bd-8881-70c6ceed4900 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:42.185758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 474/957] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:42.199942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64e8b-557f-47bd-8881-70c6ceed4900 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:42.212978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76bf5d-583f-4acf-9e82-020ea8a78304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:42.214024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76bf5d-583f-4acf-9e82-020ea8a78304 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:42.214703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76bf5d-583f-4acf-9e82-020ea8a78304 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:42.214992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76bf5d-583f-4acf-9e82-020ea8a78304 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:42.215717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76bf5d-583f-4acf-9e82-020ea8a78304 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:42.216097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76bf5d-583f-4acf-9e82-020ea8a78304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:42.218129 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76bf5d-583f-4acf-9e82-020ea8a78304 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:42.226261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 484/958] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:42.231740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76bf5d-583f-4acf-9e82-020ea8a78304 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:42.307267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64e8b-557f-47bd-8881-70c6ceed4900 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:42.340243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76bf5d-583f-4acf-9e82-020ea8a78304 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:42.345835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9550e-f545-4073-accf-1774d5d55de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:42.346511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9550e-f545-4073-accf-1774d5d55de8 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:42.346801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9550e-f545-4073-accf-1774d5d55de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:42.347093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9550e-f545-4073-accf-1774d5d55de8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:42.347833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9550e-f545-4073-accf-1774d5d55de8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:42.349242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9550e-f545-4073-accf-1774d5d55de8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:42.376204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 475/959] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 21:59:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:42.384218 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76270-1804-4526-bd32-1ef37c2b12ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:42.384903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76270-1804-4526-bd32-1ef37c2b12ce None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:42.385187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76270-1804-4526-bd32-1ef37c2b12ce None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:42.385469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76270-1804-4526-bd32-1ef37c2b12ce None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:42.386202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca76270-1804-4526-bd32-1ef37c2b12ce None admin] RBAC: Adding query filter params (type=compute) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:42.386513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca76270-1804-4526-bd32-1ef37c2b12ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:42.387985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca76270-1804-4526-bd32-1ef37c2b12ce None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:42.390661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:42.394797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 485/960] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:42.591842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb03f-f623-46b8-95d1-3e9eeb9581ae None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:42.592258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb03f-f623-46b8-95d1-3e9eeb9581ae None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:42.592445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb03f-f623-46b8-95d1-3e9eeb9581ae None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:42.594063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 476/961] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:42.599611 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9080e18-a9f1-4c96-8553-576f89aea423 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:42.599912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9080e18-a9f1-4c96-8553-576f89aea423 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:42.600205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9080e18-a9f1-4c96-8553-576f89aea423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:42.617808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f9080e18-a9f1-4c96-8553-576f89aea423 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:42.618992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f9080e18-a9f1-4c96-8553-576f89aea423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:42.692112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 486/962] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:42.712717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb03f-f623-46b8-95d1-3e9eeb9581ae None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:42.751424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:42.824956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb03f-f623-46b8-95d1-3e9eeb9581ae None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:42.861170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:42.861845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:42.862128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:42.862401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:42.863112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:42.864604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:42.866661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WARNING keystone.server.flask.common [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 21:59:42.880768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.sql.core [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 21:59:42.880768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 21:59:42.880768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [parameters: {'user_id': '3f9800ec681747ebb408e9b67886a95d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 21:59:42.880768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80410) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application conn.query(q) Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result.read() Jul 13 21:59:42.888880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 21:59:42.891446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application next(self.gen) Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application yield resource Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application next(self.gen) Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise self.value Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application session.commit() Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 21:59:42.894041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.session.flush() Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application compat.raise_( Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 21:59:42.896183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 21:59:42.898353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application conn.query(q) Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application result.read() Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 21:59:42.905697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [parameters: {'user_id': '3f9800ec681747ebb408e9b67886a95d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:42.907835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 13 21:59:42.913661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 13 21:59:42.915955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 13 21:59:42.915955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 13 21:59:42.915955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 21:59:42.915955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 21:59:42.915955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 21:59:42.915955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:42.915955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 477/963] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 21:59:42 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:42.916731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9080e18-a9f1-4c96-8553-576f89aea423 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:43.013583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9080e18-a9f1-4c96-8553-576f89aea423 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:43.043387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:43.050163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3cfab-8173-4dab-b859-9fb5864b6756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:43.050957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3cfab-8173-4dab-b859-9fb5864b6756 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:43.051241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3cfab-8173-4dab-b859-9fb5864b6756 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:43.051518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3cfab-8173-4dab-b859-9fb5864b6756 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:43.059063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3cfab-8173-4dab-b859-9fb5864b6756 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:43.060559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3cfab-8173-4dab-b859-9fb5864b6756 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-eaa3cfab-8173-4dab-b859-9fb5864b6756 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:43.075668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:43.077880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 21:59:43.080214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:43.087919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 487/964] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:43.088136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:43.183882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:43.191343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7e09-634d-4398-a1a1-2b6916796d3f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:43.228094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25754c0d-b4e1-4314-b338-4f229c67dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:43.228816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754c0d-b4e1-4314-b338-4f229c67dd37 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:43.229103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754c0d-b4e1-4314-b338-4f229c67dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:43.229378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754c0d-b4e1-4314-b338-4f229c67dd37 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:43.230184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25754c0d-b4e1-4314-b338-4f229c67dd37 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:43.230487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25754c0d-b4e1-4314-b338-4f229c67dd37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:43.232132 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25754c0d-b4e1-4314-b338-4f229c67dd37 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:43.280147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 478/965] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 21:59:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:44.237681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f7102-ddd1-46f2-844f-f62f22f6e72d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.238210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f7102-ddd1-46f2-844f-f62f22f6e72d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.238210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f7102-ddd1-46f2-844f-f62f22f6e72d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.239792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 488/966] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:44.248996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c220-9b55-4595-a2bb-1f4b55c013d2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.249468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c220-9b55-4595-a2bb-1f4b55c013d2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.249548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c220-9b55-4595-a2bb-1f4b55c013d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.267828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7598c220-9b55-4595-a2bb-1f4b55c013d2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:44.269566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7598c220-9b55-4595-a2bb-1f4b55c013d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:44.338868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 479/967] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:44.361023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f7102-ddd1-46f2-844f-f62f22f6e72d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:44.464308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f7102-ddd1-46f2-844f-f62f22f6e72d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:44.499078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447f24f-a8d8-4e52-bd93-e65ca2155eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:44.499883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447f24f-a8d8-4e52-bd93-e65ca2155eaf None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.500190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447f24f-a8d8-4e52-bd93-e65ca2155eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.500993 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447f24f-a8d8-4e52-bd93-e65ca2155eaf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.506870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a72823-a79a-467b-bc85-3929e2ff5e9e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.507123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a72823-a79a-467b-bc85-3929e2ff5e9e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.507388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a72823-a79a-467b-bc85-3929e2ff5e9e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.508946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 480/968] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:44.512128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447f24f-a8d8-4e52-bd93-e65ca2155eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:44.513724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b6d8c-3c33-488a-8ded-5fcb8f1f3aeb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.514017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b6d8c-3c33-488a-8ded-5fcb8f1f3aeb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.514297 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b6d8c-3c33-488a-8ded-5fcb8f1f3aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b447f24f-a8d8-4e52-bd93-e65ca2155eaf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:44.520713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:44.521821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:44.522690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 489/969] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 21:59:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:44.523792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a5df-252f-486b-a3e3-9fd324080c4f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.523792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a5df-252f-486b-a3e3-9fd324080c4f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.524123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a5df-252f-486b-a3e3-9fd324080c4f None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.525394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 490/970] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:44.528269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435a5df-252f-486b-a3e3-9fd324080c4f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:44.533304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-be7b6d8c-3c33-488a-8ded-5fcb8f1f3aeb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:44.534513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-be7b6d8c-3c33-488a-8ded-5fcb8f1f3aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:44.586054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:44.603467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 481/971] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:44.604898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f77857-c3c4-4663-b184-f9d7bf75b7bd None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.605193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f77857-c3c4-4663-b184-f9d7bf75b7bd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.605469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f77857-c3c4-4663-b184-f9d7bf75b7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.622300 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d1f77857-c3c4-4663-b184-f9d7bf75b7bd None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:44.623403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d1f77857-c3c4-4663-b184-f9d7bf75b7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:44.633033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:44.638897 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435a5df-252f-486b-a3e3-9fd324080c4f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:44.677433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b1e54-93fa-4343-9767-2e17f8cad9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:44.678103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b1e54-93fa-4343-9767-2e17f8cad9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.678394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b1e54-93fa-4343-9767-2e17f8cad9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.678667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b1e54-93fa-4343-9767-2e17f8cad9e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.679418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b1e54-93fa-4343-9767-2e17f8cad9e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:44.679726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b1e54-93fa-4343-9767-2e17f8cad9e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:44.681125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b1e54-93fa-4343-9767-2e17f8cad9e4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:44.691247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 491/972] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 21:59:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:44.692745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b1e54-93fa-4343-9767-2e17f8cad9e4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:44.697067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 482/973] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:44.697910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f77857-c3c4-4663-b184-f9d7bf75b7bd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:44.807702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f77857-c3c4-4663-b184-f9d7bf75b7bd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:44.828269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b1e54-93fa-4343-9767-2e17f8cad9e4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:44.843042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:44.848584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66c69c-4453-4a32-b3e7-3e330e209999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:44.849843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66c69c-4453-4a32-b3e7-3e330e209999 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.849843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66c69c-4453-4a32-b3e7-3e330e209999 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.850054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66c69c-4453-4a32-b3e7-3e330e209999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.860987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66c69c-4453-4a32-b3e7-3e330e209999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:44.862431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66c69c-4453-4a32-b3e7-3e330e209999 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:44.865870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:44.872392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31732acf-f9b4-44d8-95d9-f1a1eb7a104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:44.873139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31732acf-f9b4-44d8-95d9-f1a1eb7a104e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:44.873420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31732acf-f9b4-44d8-95d9-f1a1eb7a104e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:44.873695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31732acf-f9b4-44d8-95d9-f1a1eb7a104e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:44.874352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31732acf-f9b4-44d8-95d9-f1a1eb7a104e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:44.876362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31732acf-f9b4-44d8-95d9-f1a1eb7a104e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-1a66c69c-4453-4a32-b3e7-3e330e209999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:44.883256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:44.884355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:44.885463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:44.885463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:44.885463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:44.885463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:44.886600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 483/974] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:44.888281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66c69c-4453-4a32-b3e7-3e330e209999 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-31732acf-f9b4-44d8-95d9-f1a1eb7a104e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:44.889543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:44.893754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:44.895125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 492/975] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:44.897981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31732acf-f9b4-44d8-95d9-f1a1eb7a104e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:45.008279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66c69c-4453-4a32-b3e7-3e330e209999 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:45.010548 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31732acf-f9b4-44d8-95d9-f1a1eb7a104e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:45.047754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd88854-ab8d-44cb-9b3b-f51fe8f9a9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:45.048448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd88854-ab8d-44cb-9b3b-f51fe8f9a9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:45.048731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd88854-ab8d-44cb-9b3b-f51fe8f9a9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:45.049010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd88854-ab8d-44cb-9b3b-f51fe8f9a9a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:45.049730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd88854-ab8d-44cb-9b3b-f51fe8f9a9a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:45.050041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd88854-ab8d-44cb-9b3b-f51fe8f9a9a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:45.051400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd88854-ab8d-44cb-9b3b-f51fe8f9a9a6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:45.058312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2911-c3a6-43e3-b2be-7273048d1600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:45.058986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2911-c3a6-43e3-b2be-7273048d1600 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:45.059774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2911-c3a6-43e3-b2be-7273048d1600 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:45.060240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2911-c3a6-43e3-b2be-7273048d1600 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:45.060983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde2911-c3a6-43e3-b2be-7273048d1600 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:45.062827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde2911-c3a6-43e3-b2be-7273048d1600 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:45.064349 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 493/976] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:45.065171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd88854-ab8d-44cb-9b3b-f51fe8f9a9a6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:45.093058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 484/977] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:59:44 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:45.095001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2911-c3a6-43e3-b2be-7273048d1600 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:45.114731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:45.168885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:45.193019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd88854-ab8d-44cb-9b3b-f51fe8f9a9a6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:45.232626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2911-c3a6-43e3-b2be-7273048d1600 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:45.239651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903908-d5fd-4809-a9d0-a2525d5e3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:45.240391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903908-d5fd-4809-a9d0-a2525d5e3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:45.240649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903908-d5fd-4809-a9d0-a2525d5e3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:45.240927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903908-d5fd-4809-a9d0-a2525d5e3ee5 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:45.241662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903908-d5fd-4809-a9d0-a2525d5e3ee5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:45.241972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903908-d5fd-4809-a9d0-a2525d5e3ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:45.243643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903908-d5fd-4809-a9d0-a2525d5e3ee5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:45.255952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 494/978] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:45.258364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903908-d5fd-4809-a9d0-a2525d5e3ee5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:45.282500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe22de9-143b-4e96-9163-bcdf4707ab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:45.284063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe22de9-143b-4e96-9163-bcdf4707ab8b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:45.284063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe22de9-143b-4e96-9163-bcdf4707ab8b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:45.284063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe22de9-143b-4e96-9163-bcdf4707ab8b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:45.291957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe22de9-143b-4e96-9163-bcdf4707ab8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:45.294218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe22de9-143b-4e96-9163-bcdf4707ab8b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-cbe22de9-143b-4e96-9163-bcdf4707ab8b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:45.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:45.312192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:45.314275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 485/979] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 21:59:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:45.318865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe22de9-143b-4e96-9163-bcdf4707ab8b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:45.408053 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:45.412610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903908-d5fd-4809-a9d0-a2525d5e3ee5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:45.442653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe22de9-143b-4e96-9163-bcdf4707ab8b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:45.458124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86465594-13b2-4608-9ede-398cf49208e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:45.458840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:45.460714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86465594-13b2-4608-9ede-398cf49208e2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:45.461283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86465594-13b2-4608-9ede-398cf49208e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:45.461676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86465594-13b2-4608-9ede-398cf49208e2 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:45.462424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86465594-13b2-4608-9ede-398cf49208e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:45.462758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86465594-13b2-4608-9ede-398cf49208e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:45.464195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86465594-13b2-4608-9ede-398cf49208e2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:45.469507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 495/980] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:45.475137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86465594-13b2-4608-9ede-398cf49208e2 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:45.486552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a301b6f-7904-479a-91d8-9397c813f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:45.487233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a301b6f-7904-479a-91d8-9397c813f7ce None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:45.487520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a301b6f-7904-479a-91d8-9397c813f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:45.487801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a301b6f-7904-479a-91d8-9397c813f7ce None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:45.488707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a301b6f-7904-479a-91d8-9397c813f7ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:45.489068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a301b6f-7904-479a-91d8-9397c813f7ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:45.490436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a301b6f-7904-479a-91d8-9397c813f7ce None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:45.515186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 486/981] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 21:59:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:45.516873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a301b6f-7904-479a-91d8-9397c813f7ce None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:45.582240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86465594-13b2-4608-9ede-398cf49208e2 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:45.616161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe43ca-62ef-4a3f-90a9-5e76f28b1b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:45.616822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe43ca-62ef-4a3f-90a9-5e76f28b1b99 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:45.617110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe43ca-62ef-4a3f-90a9-5e76f28b1b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:45.617387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe43ca-62ef-4a3f-90a9-5e76f28b1b99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:45.618200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe43ca-62ef-4a3f-90a9-5e76f28b1b99 None admin] RBAC: Adding query filter params (interface=admin, service_id=25f6f16d08824b5289e4400c2c3141e1, region_id=RegionOne) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:45.618531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe43ca-62ef-4a3f-90a9-5e76f28b1b99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:45.619870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe43ca-62ef-4a3f-90a9-5e76f28b1b99 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:45.620394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a301b6f-7904-479a-91d8-9397c813f7ce None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:45.626569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 496/982] 10.222.0.17 () {56 vars in 1249 bytes} [Wed Jul 13 21:59:45 2022] GET /identity/v3/endpoints?service_id=25f6f16d08824b5289e4400c2c3141e1&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:45.632174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe43ca-62ef-4a3f-90a9-5e76f28b1b99 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:45.663107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:45.665452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279698d-c3a2-47ed-a817-b2ed58a1fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:45.666105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279698d-c3a2-47ed-a817-b2ed58a1fe73 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:45.666389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279698d-c3a2-47ed-a817-b2ed58a1fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:45.666669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279698d-c3a2-47ed-a817-b2ed58a1fe73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:45.707604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:45.738077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279698d-c3a2-47ed-a817-b2ed58a1fe73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:45.739526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279698d-c3a2-47ed-a817-b2ed58a1fe73 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:45.749630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe43ca-62ef-4a3f-90a9-5e76f28b1b99 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:45.789164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbbed4-5bc0-4d62-96c3-5a48b7e4b2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:45.789834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbbed4-5bc0-4d62-96c3-5a48b7e4b2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:45.790121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbbed4-5bc0-4d62-96c3-5a48b7e4b2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:45.790408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbbed4-5bc0-4d62-96c3-5a48b7e4b2e3 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:45.791488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbbed4-5bc0-4d62-96c3-5a48b7e4b2e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:45.792504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbbed4-5bc0-4d62-96c3-5a48b7e4b2e3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:45.807933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 497/983] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 21:59:45 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 21:59:45.856270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 487/984] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:45 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 21:59:45.862710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbbed4-5bc0-4d62-96c3-5a48b7e4b2e3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:45.965580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:45.976128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbbed4-5bc0-4d62-96c3-5a48b7e4b2e3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:46.017124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7705-8436-48b6-ba1d-291424c2ea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:46.017926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7705-8436-48b6-ba1d-291424c2ea84 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:46.018214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7705-8436-48b6-ba1d-291424c2ea84 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:46.018488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7705-8436-48b6-ba1d-291424c2ea84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:46.029258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b7705-8436-48b6-ba1d-291424c2ea84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:46.030704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b7705-8436-48b6-ba1d-291424c2ea84 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ce4b7705-8436-48b6-ba1d-291424c2ea84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:46.048699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:46.049651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:46.050545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:46.050545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:46.050545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:46.050545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:46.050545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 498/985] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:46.055803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279698d-c3a2-47ed-a817-b2ed58a1fe73 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:46.134640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:46.166577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279698d-c3a2-47ed-a817-b2ed58a1fe73 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:46.200428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccaa8-a9d0-4d72-b828-a162a35c6ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:46.201099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccaa8-a9d0-4d72-b828-a162a35c6ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:46.201385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccaa8-a9d0-4d72-b828-a162a35c6ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:46.201668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccaa8-a9d0-4d72-b828-a162a35c6ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:46.202392 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dccaa8-a9d0-4d72-b828-a162a35c6ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:46.202703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dccaa8-a9d0-4d72-b828-a162a35c6ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:46.204632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dccaa8-a9d0-4d72-b828-a162a35c6ea3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:46.216611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 488/986] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:46.222033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7705-8436-48b6-ba1d-291424c2ea84 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:46.329732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7705-8436-48b6-ba1d-291424c2ea84 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:46.366172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b6d0-1a1d-4642-bf4c-0046f1777da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:46.366964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b6d0-1a1d-4642-bf4c-0046f1777da7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:46.367246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b6d0-1a1d-4642-bf4c-0046f1777da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:46.367549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b6d0-1a1d-4642-bf4c-0046f1777da7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:46.374189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1b6d0-1a1d-4642-bf4c-0046f1777da7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:46.375705 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1b6d0-1a1d-4642-bf4c-0046f1777da7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-ceb1b6d0-1a1d-4642-bf4c-0046f1777da7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:46.390052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:46.391487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:46.392413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:46.392413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:46.392413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:46.392413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:46.392413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:46.392413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:46.392413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:46.392413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:46.392413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 499/987] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:46.397634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccaa8-a9d0-4d72-b828-a162a35c6ea3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:46.497217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccaa8-a9d0-4d72-b828-a162a35c6ea3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:46.525934 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:46.533173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5874a-d982-4ee8-a418-03215e0db10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:46.533839 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5874a-d982-4ee8-a418-03215e0db10c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:46.534123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5874a-d982-4ee8-a418-03215e0db10c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:46.534402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5874a-d982-4ee8-a418-03215e0db10c None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:46.535182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5874a-d982-4ee8-a418-03215e0db10c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:46.535490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5874a-d982-4ee8-a418-03215e0db10c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:46.536949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5874a-d982-4ee8-a418-03215e0db10c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:46.554370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 489/988] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:46.555513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b6d0-1a1d-4642-bf4c-0046f1777da7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:46.559256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:46.661787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b6d0-1a1d-4642-bf4c-0046f1777da7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:46.695595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534a075-e2b3-4549-8432-efb19fe7c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:46.696279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534a075-e2b3-4549-8432-efb19fe7c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:46.696567 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534a075-e2b3-4549-8432-efb19fe7c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:46.696850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534a075-e2b3-4549-8432-efb19fe7c6d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:46.697680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534a075-e2b3-4549-8432-efb19fe7c6d2 None admin] RBAC: Adding query filter params (role.id=7670d309329c458c8cdf908d84bd2fd6, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=63cf0ef7c80d4527ae14a6db28bbbc39) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:46.697993 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534a075-e2b3-4549-8432-efb19fe7c6d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:46.699415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534a075-e2b3-4549-8432-efb19fe7c6d2 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:46.705869 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 500/989] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:46 2022] GET /identity/v3/role_assignments?user.id=63cf0ef7c80d4527ae14a6db28bbbc39&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=7670d309329c458c8cdf908d84bd2fd6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:47.230757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc15b5-4ed6-4923-adba-ad19cd2871b3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:47.231125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc15b5-4ed6-4923-adba-ad19cd2871b3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:47.231347 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc15b5-4ed6-4923-adba-ad19cd2871b3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:47.232762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 490/990] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:47.238437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0af813-b056-4e8e-9048-a912afa91875 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:47.238740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0af813-b056-4e8e-9048-a912afa91875 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:47.239020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0af813-b056-4e8e-9048-a912afa91875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:47.256100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fd0af813-b056-4e8e-9048-a912afa91875 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:47.257282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fd0af813-b056-4e8e-9048-a912afa91875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:47.319789 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:47.325589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 501/991] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:47.347890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc15b5-4ed6-4923-adba-ad19cd2871b3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:47.451182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc15b5-4ed6-4923-adba-ad19cd2871b3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:47.487119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66840ab-8994-4e29-b8fd-5626a3ccf340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:47.487931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66840ab-8994-4e29-b8fd-5626a3ccf340 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:47.488218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66840ab-8994-4e29-b8fd-5626a3ccf340 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:47.488495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66840ab-8994-4e29-b8fd-5626a3ccf340 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:47.489142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66840ab-8994-4e29-b8fd-5626a3ccf340 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:47.490498 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66840ab-8994-4e29-b8fd-5626a3ccf340 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-b66840ab-8994-4e29-b8fd-5626a3ccf340 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:47.503074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:47.504345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 21:59:47.505209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:47.509213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 491/992] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:47.510196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0af813-b056-4e8e-9048-a912afa91875 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:47.608355 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0af813-b056-4e8e-9048-a912afa91875 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:47.642717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81307ac1-1571-4f55-bd2f-9e5ab4acc1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:47.643369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81307ac1-1571-4f55-bd2f-9e5ab4acc1fb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:47.643652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81307ac1-1571-4f55-bd2f-9e5ab4acc1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:47.643983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81307ac1-1571-4f55-bd2f-9e5ab4acc1fb None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:47.644688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81307ac1-1571-4f55-bd2f-9e5ab4acc1fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:47.644991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81307ac1-1571-4f55-bd2f-9e5ab4acc1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:47.646391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81307ac1-1571-4f55-bd2f-9e5ab4acc1fb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:47.655712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 502/993] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:47.657134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66840ab-8994-4e29-b8fd-5626a3ccf340 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:47.714004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:47.761834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66840ab-8994-4e29-b8fd-5626a3ccf340 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:47.795648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505cfa0-98b1-4a27-8c63-b0f864f9bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:47.796346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505cfa0-98b1-4a27-8c63-b0f864f9bc2a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:47.796635 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505cfa0-98b1-4a27-8c63-b0f864f9bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:47.797563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505cfa0-98b1-4a27-8c63-b0f864f9bc2a None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:47.798391 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505cfa0-98b1-4a27-8c63-b0f864f9bc2a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:47.798703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505cfa0-98b1-4a27-8c63-b0f864f9bc2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:47.800084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505cfa0-98b1-4a27-8c63-b0f864f9bc2a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:47.805457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 492/994] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:47.811040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81307ac1-1571-4f55-bd2f-9e5ab4acc1fb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:47.853316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be298d2-c0a0-436b-bdc9-185d84241fb3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:47.853728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be298d2-c0a0-436b-bdc9-185d84241fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:47.854017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be298d2-c0a0-436b-bdc9-185d84241fb3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:47.855417 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 493/995] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:47.861314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021c19-4ed1-42ea-b59b-648161eaff1c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:47.861606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021c19-4ed1-42ea-b59b-648161eaff1c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:47.861940 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021c19-4ed1-42ea-b59b-648161eaff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:47.877367 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:47.879107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-40021c19-4ed1-42ea-b59b-648161eaff1c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:47.880410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-40021c19-4ed1-42ea-b59b-648161eaff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:47.922859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81307ac1-1571-4f55-bd2f-9e5ab4acc1fb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:47.948610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 494/996] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:47.962036 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea375f02-7527-4484-adec-62a3ea1c619d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:47.962821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea375f02-7527-4484-adec-62a3ea1c619d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:47.963171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea375f02-7527-4484-adec-62a3ea1c619d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:47.963537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea375f02-7527-4484-adec-62a3ea1c619d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:47.964508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea375f02-7527-4484-adec-62a3ea1c619d None admin] RBAC: Adding query filter params (interface=public, service_id=d766d56f67ce43859db535fd39e34024, region_id=RegionOne) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:47.964836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea375f02-7527-4484-adec-62a3ea1c619d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:47.966304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea375f02-7527-4484-adec-62a3ea1c619d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:47.971396 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021c19-4ed1-42ea-b59b-648161eaff1c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:47.976063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 503/997] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 21:59:47 2022] GET /identity/v3/endpoints?service_id=d766d56f67ce43859db535fd39e34024&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:47.977020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea375f02-7527-4484-adec-62a3ea1c619d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:48.023465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:48.080917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021c19-4ed1-42ea-b59b-648161eaff1c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:48.081818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea375f02-7527-4484-adec-62a3ea1c619d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:48.114153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:48.121165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073d0d3-9666-4d4b-94cc-f45dbb2f4345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:48.121980 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073d0d3-9666-4d4b-94cc-f45dbb2f4345 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:48.122312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073d0d3-9666-4d4b-94cc-f45dbb2f4345 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:48.122697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073d0d3-9666-4d4b-94cc-f45dbb2f4345 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:48.123457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073d0d3-9666-4d4b-94cc-f45dbb2f4345 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:48.124067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7275d1-59d8-401c-beba-d4ef853b7d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:48.124812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7275d1-59d8-401c-beba-d4ef853b7d59 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:48.124916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073d0d3-9666-4d4b-94cc-f45dbb2f4345 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:48.125249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7275d1-59d8-401c-beba-d4ef853b7d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:48.125734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7275d1-59d8-401c-beba-d4ef853b7d59 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:48.126928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7275d1-59d8-401c-beba-d4ef853b7d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:48.129584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7275d1-59d8-401c-beba-d4ef853b7d59 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f073d0d3-9666-4d4b-94cc-f45dbb2f4345 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:48.138150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:48.139120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 21:59:48.146065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:48.146858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 504/998] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 21:59:47 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 21:59:48.146933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 495/999] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 21:59:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:48.148590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7275d1-59d8-401c-beba-d4ef853b7d59 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:48.262763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7275d1-59d8-401c-beba-d4ef853b7d59 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:48.300754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdae870-ef83-4be8-9c1a-733776609385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:48.301421 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdae870-ef83-4be8-9c1a-733776609385 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:48.301705 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdae870-ef83-4be8-9c1a-733776609385 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:48.302006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdae870-ef83-4be8-9c1a-733776609385 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:48.302710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdae870-ef83-4be8-9c1a-733776609385 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:48.303016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdae870-ef83-4be8-9c1a-733776609385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:48.304408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdae870-ef83-4be8-9c1a-733776609385 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:48.309689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 505/1000] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:48.317540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073d0d3-9666-4d4b-94cc-f45dbb2f4345 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:48.423617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073d0d3-9666-4d4b-94cc-f45dbb2f4345 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:48.436793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:48.460306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cac1f-bbe3-4a85-8cc2-6c1fcbd0a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:48.461729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cac1f-bbe3-4a85-8cc2-6c1fcbd0a8ea None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:48.462026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cac1f-bbe3-4a85-8cc2-6c1fcbd0a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:48.462341 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cac1f-bbe3-4a85-8cc2-6c1fcbd0a8ea None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:48.463073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cac1f-bbe3-4a85-8cc2-6c1fcbd0a8ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:48.463390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cac1f-bbe3-4a85-8cc2-6c1fcbd0a8ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:48.464813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cac1f-bbe3-4a85-8cc2-6c1fcbd0a8ea None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:48.470602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 496/1001] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 21:59:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:48.476505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdae870-ef83-4be8-9c1a-733776609385 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:48.534107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:48.582415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdae870-ef83-4be8-9c1a-733776609385 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:48.616447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e2d1a-f61c-489b-85ec-50f57848ca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:48.617113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2d1a-f61c-489b-85ec-50f57848ca98 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:48.617401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2d1a-f61c-489b-85ec-50f57848ca98 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:48.617681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2d1a-f61c-489b-85ec-50f57848ca98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:48.618632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e2d1a-f61c-489b-85ec-50f57848ca98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:48.620072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e2d1a-f61c-489b-85ec-50f57848ca98 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:48.639980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 506/1002] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 21:59:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:48.793539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310f54b-fdaa-476a-a632-f6a03979a0f5 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:48.793836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310f54b-fdaa-476a-a632-f6a03979a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:48.794037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310f54b-fdaa-476a-a632-f6a03979a0f5 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:48.795426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 497/1003] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:48.801479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7f6a-47d6-46c3-9f91-7a01caf7f197 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:48.801767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7f6a-47d6-46c3-9f91-7a01caf7f197 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:48.802073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7f6a-47d6-46c3-9f91-7a01caf7f197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:48.820409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-efdc7f6a-47d6-46c3-9f91-7a01caf7f197 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:48.821606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-efdc7f6a-47d6-46c3-9f91-7a01caf7f197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:48.895459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 507/1004] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:48.917791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310f54b-fdaa-476a-a632-f6a03979a0f5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:49.020977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310f54b-fdaa-476a-a632-f6a03979a0f5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:49.054435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e600823-6a77-4d5a-9638-3fff7702f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:49.055156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e600823-6a77-4d5a-9638-3fff7702f97b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:49.055439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e600823-6a77-4d5a-9638-3fff7702f97b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:49.055715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e600823-6a77-4d5a-9638-3fff7702f97b None admin] PATH_INFO: `/v3/services/image` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:49.056396 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e600823-6a77-4d5a-9638-3fff7702f97b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:49.057757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e600823-6a77-4d5a-9638-3fff7702f97b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-7e600823-6a77-4d5a-9638-3fff7702f97b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:49.069683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:49.070658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:49.076690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 498/1005] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jul 13 21:59:48 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:49.079807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7f6a-47d6-46c3-9f91-7a01caf7f197 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:49.129961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:49.191225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7f6a-47d6-46c3-9f91-7a01caf7f197 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:49.226586 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439fa80-efd4-414f-9140-3b21ea00c26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:49.227576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439fa80-efd4-414f-9140-3b21ea00c26d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:49.228069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439fa80-efd4-414f-9140-3b21ea00c26d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:49.228520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439fa80-efd4-414f-9140-3b21ea00c26d None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:49.229412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439fa80-efd4-414f-9140-3b21ea00c26d None admin] RBAC: Adding query filter params (name=image) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:49.229917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439fa80-efd4-414f-9140-3b21ea00c26d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:49.231448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439fa80-efd4-414f-9140-3b21ea00c26d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:49.237012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 508/1006] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:49.242516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e600823-6a77-4d5a-9638-3fff7702f97b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:49.287597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:49.346320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e600823-6a77-4d5a-9638-3fff7702f97b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:49.379937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e909a22-82c5-43da-9201-ae8a7ff7505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:49.380610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e909a22-82c5-43da-9201-ae8a7ff7505f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:49.380894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e909a22-82c5-43da-9201-ae8a7ff7505f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:49.381167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e909a22-82c5-43da-9201-ae8a7ff7505f None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:49.381865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e909a22-82c5-43da-9201-ae8a7ff7505f None admin] RBAC: Adding query filter params (type=image) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:49.382167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e909a22-82c5-43da-9201-ae8a7ff7505f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:49.383504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e909a22-82c5-43da-9201-ae8a7ff7505f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:49.391943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 499/1007] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:50.181390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282c811-f25c-48af-b4a7-dba68033fd1d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:50.181934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282c811-f25c-48af-b4a7-dba68033fd1d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:50.181934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282c811-f25c-48af-b4a7-dba68033fd1d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:50.183450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 509/1008] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:50.188401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c377ddd-28e1-4d85-a984-669f640c7ab3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:50.188788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c377ddd-28e1-4d85-a984-669f640c7ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:50.188965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c377ddd-28e1-4d85-a984-669f640c7ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:50.206570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4c377ddd-28e1-4d85-a984-669f640c7ab3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:50.207758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4c377ddd-28e1-4d85-a984-669f640c7ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:50.275669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 500/1009] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:50.298460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282c811-f25c-48af-b4a7-dba68033fd1d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:50.400907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282c811-f25c-48af-b4a7-dba68033fd1d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:50.403133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:50.435878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785581f-5ab7-4da4-836a-e6c544f8d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:50.436697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785581f-5ab7-4da4-836a-e6c544f8d001 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:50.436980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785581f-5ab7-4da4-836a-e6c544f8d001 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:50.437255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785581f-5ab7-4da4-836a-e6c544f8d001 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:50.438251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785581f-5ab7-4da4-836a-e6c544f8d001 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:50.439607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785581f-5ab7-4da4-836a-e6c544f8d001 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-7785581f-5ab7-4da4-836a-e6c544f8d001 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:50.451555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:50.452715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 21:59:50.454410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:50.456244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 510/1010] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:50.459718 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c377ddd-28e1-4d85-a984-669f640c7ab3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:50.494858 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:50.561934 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c377ddd-28e1-4d85-a984-669f640c7ab3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:50.596830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbf243-9664-4591-a2d6-2f7c88852621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:50.597792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf243-9664-4591-a2d6-2f7c88852621 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:50.598270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf243-9664-4591-a2d6-2f7c88852621 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:50.598723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf243-9664-4591-a2d6-2f7c88852621 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:50.599598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbf243-9664-4591-a2d6-2f7c88852621 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:50.600120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbf243-9664-4591-a2d6-2f7c88852621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:50.601650 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbf243-9664-4591-a2d6-2f7c88852621 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:50.611123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 501/1011] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:50.612348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785581f-5ab7-4da4-836a-e6c544f8d001 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:50.696614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040e7e-b543-427a-8d51-d3c605c133d3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:50.696807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040e7e-b543-427a-8d51-d3c605c133d3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:50.697093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040e7e-b543-427a-8d51-d3c605c133d3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:50.698600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 502/1012] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:50.703284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdca5be-0a60-436c-9603-349454dba44b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:50.703578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdca5be-0a60-436c-9603-349454dba44b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:50.703867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdca5be-0a60-436c-9603-349454dba44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:50.717419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785581f-5ab7-4da4-836a-e6c544f8d001 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:50.720848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1fdca5be-0a60-436c-9603-349454dba44b None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:50.722018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1fdca5be-0a60-436c-9603-349454dba44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:50.752463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcccb95-8a25-4f0d-b4fa-f2169383813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:50.753399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcccb95-8a25-4f0d-b4fa-f2169383813a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:50.753867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcccb95-8a25-4f0d-b4fa-f2169383813a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:50.754152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcccb95-8a25-4f0d-b4fa-f2169383813a None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:50.754844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcccb95-8a25-4f0d-b4fa-f2169383813a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:50.755150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcccb95-8a25-4f0d-b4fa-f2169383813a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:50.756541 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcccb95-8a25-4f0d-b4fa-f2169383813a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:50.761876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 511/1013] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 21:59:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:50.767421 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcccb95-8a25-4f0d-b4fa-f2169383813a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:50.794371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 503/1014] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:50.801693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:50.818287 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdca5be-0a60-436c-9603-349454dba44b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:50.846067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:50.875964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcccb95-8a25-4f0d-b4fa-f2169383813a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:50.913171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c18e6-b8b1-4a7b-9817-bd12f811152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:50.913825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c18e6-b8b1-4a7b-9817-bd12f811152e None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:50.914111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c18e6-b8b1-4a7b-9817-bd12f811152e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:50.914389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c18e6-b8b1-4a7b-9817-bd12f811152e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:50.915122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c18e6-b8b1-4a7b-9817-bd12f811152e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:50.916502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c18e6-b8b1-4a7b-9817-bd12f811152e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:50.920412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdca5be-0a60-436c-9603-349454dba44b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:50.936572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 512/1015] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 21:59:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 21:59:50.966752 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de841a4-eb56-49fc-b7b3-7ecc9f477a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:50.967481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de841a4-eb56-49fc-b7b3-7ecc9f477a6c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:50.967767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de841a4-eb56-49fc-b7b3-7ecc9f477a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:50.968111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de841a4-eb56-49fc-b7b3-7ecc9f477a6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:50.969606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de841a4-eb56-49fc-b7b3-7ecc9f477a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:50.971142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de841a4-eb56-49fc-b7b3-7ecc9f477a6c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:50.977898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 504/1016] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:50.979272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c18e6-b8b1-4a7b-9817-bd12f811152e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:51.076324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:51.092015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c18e6-b8b1-4a7b-9817-bd12f811152e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:51.132291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e33b13-b710-405b-abd4-19cc05e780f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:51.132984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e33b13-b710-405b-abd4-19cc05e780f1 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:51.133269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e33b13-b710-405b-abd4-19cc05e780f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:51.133544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e33b13-b710-405b-abd4-19cc05e780f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:51.134250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e33b13-b710-405b-abd4-19cc05e780f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:51.135698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e33b13-b710-405b-abd4-19cc05e780f1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:51.163410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 513/1017] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:59:50 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:51.445431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278a79-772a-48c5-961a-194b73206d52 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:51.445950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278a79-772a-48c5-961a-194b73206d52 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:51.446030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278a79-772a-48c5-961a-194b73206d52 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:51.447516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 505/1018] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:51.452698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7282-033d-4bbc-b9c4-a36907ebeed6 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:51.453662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7282-033d-4bbc-b9c4-a36907ebeed6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:51.454095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7282-033d-4bbc-b9c4-a36907ebeed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:51.471456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7a8e7282-033d-4bbc-b9c4-a36907ebeed6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:51.472690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7a8e7282-033d-4bbc-b9c4-a36907ebeed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:51.543997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 514/1019] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:51 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:51.565756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278a79-772a-48c5-961a-194b73206d52 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:51.661476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:51.673364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278a79-772a-48c5-961a-194b73206d52 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:51.709645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba58f7d-24d6-454c-b4ad-4a0f1e80f962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:51.710238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58f7d-24d6-454c-b4ad-4a0f1e80f962 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:51.710576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58f7d-24d6-454c-b4ad-4a0f1e80f962 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:51.710862 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58f7d-24d6-454c-b4ad-4a0f1e80f962 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:51.711768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba58f7d-24d6-454c-b4ad-4a0f1e80f962 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:51.713179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba58f7d-24d6-454c-b4ad-4a0f1e80f962 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:51.735942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 506/1020] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 21:59:51 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:53.132295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11cd2-6d11-40cc-9d86-350e5ce4a661 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.132795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11cd2-6d11-40cc-9d86-350e5ce4a661 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.132905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11cd2-6d11-40cc-9d86-350e5ce4a661 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.134366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 515/1021] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:53.139326 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69cfff-d44e-4aa3-a551-861a70bc47d5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.139707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69cfff-d44e-4aa3-a551-861a70bc47d5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.139891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69cfff-d44e-4aa3-a551-861a70bc47d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.156953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ea69cfff-d44e-4aa3-a551-861a70bc47d5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:53.158121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ea69cfff-d44e-4aa3-a551-861a70bc47d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:53.228226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360baf-8c4a-4498-ba7b-99ebb2b034fc None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.228563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360baf-8c4a-4498-ba7b-99ebb2b034fc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.228791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360baf-8c4a-4498-ba7b-99ebb2b034fc None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.230012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 507/1022] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:53.230341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 516/1023] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:53.235849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a3b27-aa8a-4f73-a47f-b75998e24f1a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.236173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a3b27-aa8a-4f73-a47f-b75998e24f1a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.236459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a3b27-aa8a-4f73-a47f-b75998e24f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.252511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-085a3b27-aa8a-4f73-a47f-b75998e24f1a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:53.253145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360baf-8c4a-4498-ba7b-99ebb2b034fc None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:53.253684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-085a3b27-aa8a-4f73-a47f-b75998e24f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:53.328657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 508/1024] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:53.335263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:53.355494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a3b27-aa8a-4f73-a47f-b75998e24f1a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:53.368067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:53.371412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360baf-8c4a-4498-ba7b-99ebb2b034fc None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:53.410551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd95da-7fee-45c4-a044-fa4b81fadd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:53.411365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd95da-7fee-45c4-a044-fa4b81fadd22 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.411649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd95da-7fee-45c4-a044-fa4b81fadd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.411948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd95da-7fee-45c4-a044-fa4b81fadd22 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.422919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd95da-7fee-45c4-a044-fa4b81fadd22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2ccd95da-7fee-45c4-a044-fa4b81fadd22 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:53.431077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:53.432042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:53.432895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 517/1025] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 21:59:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:53.438913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd95da-7fee-45c4-a044-fa4b81fadd22 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:53.470506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a3b27-aa8a-4f73-a47f-b75998e24f1a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:53.504431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1d2a9-a243-4342-964a-f47b16de4773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:53.505241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1d2a9-a243-4342-964a-f47b16de4773 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.505501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1d2a9-a243-4342-964a-f47b16de4773 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.505772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1d2a9-a243-4342-964a-f47b16de4773 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.506937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1d2a9-a243-4342-964a-f47b16de4773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:53.508384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1d2a9-a243-4342-964a-f47b16de4773 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:53.509997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 509/1026] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:53.515410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1d2a9-a243-4342-964a-f47b16de4773 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:53.554759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd95da-7fee-45c4-a044-fa4b81fadd22 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:53.584671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:53.590927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45758f83-4522-45a4-a563-0481298990b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:53.591684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45758f83-4522-45a4-a563-0481298990b7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.592000 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45758f83-4522-45a4-a563-0481298990b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.592280 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45758f83-4522-45a4-a563-0481298990b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.593045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45758f83-4522-45a4-a563-0481298990b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:53.593888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:53.594060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45758f83-4522-45a4-a563-0481298990b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:53.595495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45758f83-4522-45a4-a563-0481298990b7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:53.610341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 518/1027] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 21:59:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:53.611438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45758f83-4522-45a4-a563-0481298990b7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:53.622858 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1d2a9-a243-4342-964a-f47b16de4773 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:53.658800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418d63d-e77b-4520-8551-76f9242295fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:53.659471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418d63d-e77b-4520-8551-76f9242295fb None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.659759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418d63d-e77b-4520-8551-76f9242295fb None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.660064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418d63d-e77b-4520-8551-76f9242295fb None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.660779 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418d63d-e77b-4520-8551-76f9242295fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:53.662197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418d63d-e77b-4520-8551-76f9242295fb None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:53.688026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 510/1028] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 21:59:53 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 21:59:53.721642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45758f83-4522-45a4-a563-0481298990b7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:53.759498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55a33-c92b-4aeb-a8fb-0748c05d70f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:53.760312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55a33-c92b-4aeb-a8fb-0748c05d70f4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.760597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55a33-c92b-4aeb-a8fb-0748c05d70f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.760890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55a33-c92b-4aeb-a8fb-0748c05d70f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.774686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55a33-c92b-4aeb-a8fb-0748c05d70f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:53.776224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55a33-c92b-4aeb-a8fb-0748c05d70f4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b9e55a33-c92b-4aeb-a8fb-0748c05d70f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:53.797641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:53.798626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:53.804313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:53.804313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:53.804313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:53.804313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:53.804313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 519/1029] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:53.804602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d081ccc-cc6e-4131-986a-9250dc47195c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.804602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d081ccc-cc6e-4131-986a-9250dc47195c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.804602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d081ccc-cc6e-4131-986a-9250dc47195c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.805313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 511/1030] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:53.806777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55a33-c92b-4aeb-a8fb-0748c05d70f4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:53.810567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d049ad-959e-45f2-922a-c513c0372a5c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.810849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d049ad-959e-45f2-922a-c513c0372a5c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.811129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d049ad-959e-45f2-922a-c513c0372a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.829886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-92d049ad-959e-45f2-922a-c513c0372a5c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:53.831726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-92d049ad-959e-45f2-922a-c513c0372a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:53.862491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:53.914516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 512/1031] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:53.936310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55a33-c92b-4aeb-a8fb-0748c05d70f4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:53.943856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d049ad-959e-45f2-922a-c513c0372a5c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:53.973319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5d6b9-9505-4536-8572-bb1a34e55243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:53.974287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5d6b9-9505-4536-8572-bb1a34e55243 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:53.974685 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5d6b9-9505-4536-8572-bb1a34e55243 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:53.975086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5d6b9-9505-4536-8572-bb1a34e55243 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:53.976034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5d6b9-9505-4536-8572-bb1a34e55243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:53.976435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5d6b9-9505-4536-8572-bb1a34e55243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:53.977999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5d6b9-9505-4536-8572-bb1a34e55243 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:53.996175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 520/1032] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:53.997719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5d6b9-9505-4536-8572-bb1a34e55243 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:54.013822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:54.056607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d049ad-959e-45f2-922a-c513c0372a5c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:54.092826 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb16f2-8ba9-49ce-8ace-01cbc3e6851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:54.094005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb16f2-8ba9-49ce-8ace-01cbc3e6851b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:54.094395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb16f2-8ba9-49ce-8ace-01cbc3e6851b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:54.094782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb16f2-8ba9-49ce-8ace-01cbc3e6851b None admin] PATH_INFO: `/v3/services/image` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:54.095454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb16f2-8ba9-49ce-8ace-01cbc3e6851b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:54.096863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb16f2-8ba9-49ce-8ace-01cbc3e6851b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:54.102397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5d6b9-9505-4536-8572-bb1a34e55243 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-88eb16f2-8ba9-49ce-8ace-01cbc3e6851b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:54.110629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:54.111792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 21:59:54.112694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:54.116939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 513/1033] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jul 13 21:59:53 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:54.117821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb16f2-8ba9-49ce-8ace-01cbc3e6851b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:54.119637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:54.145133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139aa13-a62c-4c3c-a7f2-f7fb26d5f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:54.146032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139aa13-a62c-4c3c-a7f2-f7fb26d5f58a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:54.146382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139aa13-a62c-4c3c-a7f2-f7fb26d5f58a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:54.146736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139aa13-a62c-4c3c-a7f2-f7fb26d5f58a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:54.154181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139aa13-a62c-4c3c-a7f2-f7fb26d5f58a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:54.155635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139aa13-a62c-4c3c-a7f2-f7fb26d5f58a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-5139aa13-a62c-4c3c-a7f2-f7fb26d5f58a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:54.170499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:54.172214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:54.173302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 521/1034] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 21:59:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:54.178152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139aa13-a62c-4c3c-a7f2-f7fb26d5f58a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:54.233589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb16f2-8ba9-49ce-8ace-01cbc3e6851b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:54.263331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:54.275218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfdbd6-7b1b-416a-9687-e61f1efbc303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:54.275971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfdbd6-7b1b-416a-9687-e61f1efbc303 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:54.276266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfdbd6-7b1b-416a-9687-e61f1efbc303 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:54.276551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfdbd6-7b1b-416a-9687-e61f1efbc303 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:54.277267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfdbd6-7b1b-416a-9687-e61f1efbc303 None admin] RBAC: Adding query filter params (name=image) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:54.277582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfdbd6-7b1b-416a-9687-e61f1efbc303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:54.279005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfdbd6-7b1b-416a-9687-e61f1efbc303 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:54.280552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139aa13-a62c-4c3c-a7f2-f7fb26d5f58a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:54.284417 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 514/1035] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:54.289765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfdbd6-7b1b-416a-9687-e61f1efbc303 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:54.315586 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c5807-ea6b-4739-8090-1d9544e4acd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:54.316292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c5807-ea6b-4739-8090-1d9544e4acd0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:54.316579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c5807-ea6b-4739-8090-1d9544e4acd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:54.316861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c5807-ea6b-4739-8090-1d9544e4acd0 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:54.317789 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c5807-ea6b-4739-8090-1d9544e4acd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:54.318109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c5807-ea6b-4739-8090-1d9544e4acd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:54.319533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c5807-ea6b-4739-8090-1d9544e4acd0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:54.342111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 522/1036] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 21:59:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:54.343370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c5807-ea6b-4739-8090-1d9544e4acd0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:54.368112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:54.402551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfdbd6-7b1b-416a-9687-e61f1efbc303 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:54.438793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be5e80-7610-4956-90e3-64847449c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:54.439495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be5e80-7610-4956-90e3-64847449c30e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:54.439766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be5e80-7610-4956-90e3-64847449c30e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:54.440074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be5e80-7610-4956-90e3-64847449c30e None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:54.440888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be5e80-7610-4956-90e3-64847449c30e None admin] RBAC: Adding query filter params (type=image) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:54.441194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be5e80-7610-4956-90e3-64847449c30e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:54.442656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be5e80-7610-4956-90e3-64847449c30e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:54.452942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 515/1037] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:54.453139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c5807-ea6b-4739-8090-1d9544e4acd0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:54.454043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be5e80-7610-4956-90e3-64847449c30e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:54.489583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7e209-eb3f-4719-989c-09465a855b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:54.490240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e209-eb3f-4719-989c-09465a855b8b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:54.490538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e209-eb3f-4719-989c-09465a855b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:54.490821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e209-eb3f-4719-989c-09465a855b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:54.514315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:54.562659 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7e209-eb3f-4719-989c-09465a855b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:54.564268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be5e80-7610-4956-90e3-64847449c30e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:54.564678 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7e209-eb3f-4719-989c-09465a855b8b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:54.590110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:54.600287 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb7aa2-03db-474f-9be5-8bc3bd8dfef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:54.600957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7aa2-03db-474f-9be5-8bc3bd8dfef5 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:54.601247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7aa2-03db-474f-9be5-8bc3bd8dfef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:54.601564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7aa2-03db-474f-9be5-8bc3bd8dfef5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:54.602318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb7aa2-03db-474f-9be5-8bc3bd8dfef5 None admin] RBAC: Adding query filter params (interface=public, service_id=2240dcc25d714f69b74187670bb18a6c, region_id=RegionOne) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:54.602645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb7aa2-03db-474f-9be5-8bc3bd8dfef5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:54.604040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb7aa2-03db-474f-9be5-8bc3bd8dfef5 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:54.609045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 516/1038] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 21:59:54 2022] GET /identity/v3/endpoints?service_id=2240dcc25d714f69b74187670bb18a6c&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:54.614639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb7aa2-03db-474f-9be5-8bc3bd8dfef5 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:54.676285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 523/1039] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 21:59:54.681623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7e209-eb3f-4719-989c-09465a855b8b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:54.729429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb7aa2-03db-474f-9be5-8bc3bd8dfef5 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:54.747501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:54.766695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5a8a8-c532-47cf-84f7-319b69d7a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:54.767240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5a8a8-c532-47cf-84f7-319b69d7a521 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:54.767536 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5a8a8-c532-47cf-84f7-319b69d7a521 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:54.767822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5a8a8-c532-47cf-84f7-319b69d7a521 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:54.768528 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5a8a8-c532-47cf-84f7-319b69d7a521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:54.769905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5a8a8-c532-47cf-84f7-319b69d7a521 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:54.776544 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 517/1040] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 21:59:54 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 21:59:54.789075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7e209-eb3f-4719-989c-09465a855b8b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:54.817128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:54.830727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0691ca-de8f-4e3b-8d02-430572a04ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:54.831838 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0691ca-de8f-4e3b-8d02-430572a04ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:54.832157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0691ca-de8f-4e3b-8d02-430572a04ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:54.832436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0691ca-de8f-4e3b-8d02-430572a04ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:54.847356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0691ca-de8f-4e3b-8d02-430572a04ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:54.847559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0691ca-de8f-4e3b-8d02-430572a04ce9 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4a0691ca-de8f-4e3b-8d02-430572a04ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:54.867360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:54.868394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:54.873107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:54.873107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:54.873107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:54.873107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:54.873107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 524/1041] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:54.876377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5a8a8-c532-47cf-84f7-319b69d7a521 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:54.989216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5a8a8-c532-47cf-84f7-319b69d7a521 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:55.023214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b643e-4af5-43d8-bc92-c1b51c5b0011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:55.023958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b643e-4af5-43d8-bc92-c1b51c5b0011 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:55.024251 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b643e-4af5-43d8-bc92-c1b51c5b0011 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:55.024530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b643e-4af5-43d8-bc92-c1b51c5b0011 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:55.025252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b643e-4af5-43d8-bc92-c1b51c5b0011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:55.025561 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b643e-4af5-43d8-bc92-c1b51c5b0011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:55.026923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b643e-4af5-43d8-bc92-c1b51c5b0011 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:55.043233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 518/1042] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:55.044572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0691ca-de8f-4e3b-8d02-430572a04ce9 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:55.144811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0691ca-de8f-4e3b-8d02-430572a04ce9 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:55.178844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df6ef-9a88-43f0-bfdc-2a66bbccd525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:55.179643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df6ef-9a88-43f0-bfdc-2a66bbccd525 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:55.179959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df6ef-9a88-43f0-bfdc-2a66bbccd525 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:55.180246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df6ef-9a88-43f0-bfdc-2a66bbccd525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:55.186894 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057df6ef-9a88-43f0-bfdc-2a66bbccd525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:55.189451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057df6ef-9a88-43f0-bfdc-2a66bbccd525 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-057df6ef-9a88-43f0-bfdc-2a66bbccd525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:55.204253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:55.205158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:55.206343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:55.206343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:55.206343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:55.206343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:55.206343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:55.206343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:55.206343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:55.206343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:55.206343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 525/1043] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:55.211448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b643e-4af5-43d8-bc92-c1b51c5b0011 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:55.258477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:55.320554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b643e-4af5-43d8-bc92-c1b51c5b0011 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:55.356727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec6fa-dff4-40b9-bf9b-935a1e836666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:55.357398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec6fa-dff4-40b9-bf9b-935a1e836666 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:55.357687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec6fa-dff4-40b9-bf9b-935a1e836666 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:55.357972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec6fa-dff4-40b9-bf9b-935a1e836666 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:55.358761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ec6fa-dff4-40b9-bf9b-935a1e836666 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:55.360204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ec6fa-dff4-40b9-bf9b-935a1e836666 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:55.361638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ec6fa-dff4-40b9-bf9b-935a1e836666 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:55.373697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 519/1044] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:55.379619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df6ef-9a88-43f0-bfdc-2a66bbccd525 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:55.416066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:55.486192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df6ef-9a88-43f0-bfdc-2a66bbccd525 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:55.521374 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f430cb-2273-4dda-b212-ae19a23dddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:55.521960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f430cb-2273-4dda-b212-ae19a23dddee None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:55.522251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f430cb-2273-4dda-b212-ae19a23dddee None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:55.522534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f430cb-2273-4dda-b212-ae19a23dddee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:55.523376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f430cb-2273-4dda-b212-ae19a23dddee None admin] RBAC: Adding query filter params (role.id=7670d309329c458c8cdf908d84bd2fd6, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=44e6d786ac4a40468794b18cfedfa730) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:55.523694 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f430cb-2273-4dda-b212-ae19a23dddee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:55.525165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f430cb-2273-4dda-b212-ae19a23dddee None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:55.540301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 526/1045] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:55 2022] GET /identity/v3/role_assignments?user.id=44e6d786ac4a40468794b18cfedfa730&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=7670d309329c458c8cdf908d84bd2fd6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:55.846437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5386718-71d5-43f0-bd8a-1a4287a677f8 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:55.846777 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5386718-71d5-43f0-bd8a-1a4287a677f8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:55.846954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5386718-71d5-43f0-bd8a-1a4287a677f8 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:55.848382 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 520/1046] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:55.853493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c6018-fb02-4d24-86a5-23620e562b32 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:55.853791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c6018-fb02-4d24-86a5-23620e562b32 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:55.854073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c6018-fb02-4d24-86a5-23620e562b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:55.870662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b51c6018-fb02-4d24-86a5-23620e562b32 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:55.871841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b51c6018-fb02-4d24-86a5-23620e562b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:55.941761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 527/1047] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:55.965159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5386718-71d5-43f0-bd8a-1a4287a677f8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:56.067517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5386718-71d5-43f0-bd8a-1a4287a677f8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:56.069078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:56.101952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265988d-f7b1-4bcf-9189-2eab166b83af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:56.102675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265988d-f7b1-4bcf-9189-2eab166b83af None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:56.102960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265988d-f7b1-4bcf-9189-2eab166b83af None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:56.106253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265988d-f7b1-4bcf-9189-2eab166b83af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:56.123228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265988d-f7b1-4bcf-9189-2eab166b83af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f265988d-f7b1-4bcf-9189-2eab166b83af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:56.131691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:56.132651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:56.133493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:56.136224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 521/1048] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:56.138780 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c6018-fb02-4d24-86a5-23620e562b32 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:56.166144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:56.238978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c6018-fb02-4d24-86a5-23620e562b32 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:56.273634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2cf80-0652-4fd6-ad1b-bc6e259ff6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:56.274301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2cf80-0652-4fd6-ad1b-bc6e259ff6ff None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:56.274587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2cf80-0652-4fd6-ad1b-bc6e259ff6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:56.274866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2cf80-0652-4fd6-ad1b-bc6e259ff6ff None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:56.275614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2cf80-0652-4fd6-ad1b-bc6e259ff6ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:56.275938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2cf80-0652-4fd6-ad1b-bc6e259ff6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:56.277297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2cf80-0652-4fd6-ad1b-bc6e259ff6ff None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:56.290760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 528/1049] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:56.292055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265988d-f7b1-4bcf-9189-2eab166b83af None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:56.396131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265988d-f7b1-4bcf-9189-2eab166b83af None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:56.436188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c91b2-1df7-477d-850e-ff0a3034413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:56.437128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c91b2-1df7-477d-850e-ff0a3034413d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:56.437412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c91b2-1df7-477d-850e-ff0a3034413d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:56.437688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c91b2-1df7-477d-850e-ff0a3034413d None admin] PATH_INFO: `/v3/users/cf28e1219f034e4d8c35997a38f480e2` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:56.450918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c91b2-1df7-477d-850e-ff0a3034413d None admin] RBAC: Authorizing `identity:get_user(user_id=cf28e1219f034e4d8c35997a38f480e2)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:56.452376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c91b2-1df7-477d-850e-ff0a3034413d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:56.454963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 522/1050] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:59:56 2022] GET /identity/v3/users/cf28e1219f034e4d8c35997a38f480e2 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:56.460703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2cf80-0652-4fd6-ad1b-bc6e259ff6ff None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:56.553095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:56.564218 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2cf80-0652-4fd6-ad1b-bc6e259ff6ff None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:56.598057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f3408-6c22-4070-95eb-e858e00df64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:56.598709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f3408-6c22-4070-95eb-e858e00df64b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:56.598997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f3408-6c22-4070-95eb-e858e00df64b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:56.599277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f3408-6c22-4070-95eb-e858e00df64b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:56.668606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f3408-6c22-4070-95eb-e858e00df64b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:56.669962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f3408-6c22-4070-95eb-e858e00df64b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:56.757698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:56.774016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 529/1051] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 21:59:56.775646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c91b2-1df7-477d-850e-ff0a3034413d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:56.797930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:56.858194 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd531f3-7a73-408e-a525-46e1f1877056 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:56.858484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd531f3-7a73-408e-a525-46e1f1877056 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:56.859302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd531f3-7a73-408e-a525-46e1f1877056 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:56.860959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 530/1052] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:56.866007 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b73a1-97e0-4abd-a3f0-0b8827445b07 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:56.866297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b73a1-97e0-4abd-a3f0-0b8827445b07 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:56.866575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b73a1-97e0-4abd-a3f0-0b8827445b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:56.880508 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c91b2-1df7-477d-850e-ff0a3034413d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:56.883088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1c6b73a1-97e0-4abd-a3f0-0b8827445b07 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:56.884295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1c6b73a1-97e0-4abd-a3f0-0b8827445b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:56.922084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e89d7-b945-4f10-bf3a-f2195cd9f594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:56.922759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e89d7-b945-4f10-bf3a-f2195cd9f594 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:56.923045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e89d7-b945-4f10-bf3a-f2195cd9f594 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:56.923319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e89d7-b945-4f10-bf3a-f2195cd9f594 None admin] PATH_INFO: `/v3/projects/f24188ad9a394fa9a7553be91bbf380e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:56.924534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e89d7-b945-4f10-bf3a-f2195cd9f594 None admin] RBAC: Authorizing `identity:get_project(project_id=f24188ad9a394fa9a7553be91bbf380e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:56.926460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e89d7-b945-4f10-bf3a-f2195cd9f594 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:56.933520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 523/1053] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:59:56 2022] GET /identity/v3/projects/f24188ad9a394fa9a7553be91bbf380e => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:56.934816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e89d7-b945-4f10-bf3a-f2195cd9f594 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:56.956160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 531/1054] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:56.978262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b73a1-97e0-4abd-a3f0-0b8827445b07 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:57.031591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:57.045346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e89d7-b945-4f10-bf3a-f2195cd9f594 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:57.080195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b73a1-97e0-4abd-a3f0-0b8827445b07 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:57.081397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78f8f0-e310-4723-8925-634730004568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:57.082051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f8f0-e310-4723-8925-634730004568 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:57.082333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f8f0-e310-4723-8925-634730004568 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:57.082597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f8f0-e310-4723-8925-634730004568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:57.083466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78f8f0-e310-4723-8925-634730004568 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=f24188ad9a394fa9a7553be91bbf380e, user.id=cf28e1219f034e4d8c35997a38f480e2) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:57.083762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78f8f0-e310-4723-8925-634730004568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:57.085217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78f8f0-e310-4723-8925-634730004568 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:57.099935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 524/1055] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 21:59:56 2022] GET /identity/v3/role_assignments?user.id=cf28e1219f034e4d8c35997a38f480e2&scope.project.id=f24188ad9a394fa9a7553be91bbf380e&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:57.102353 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:57.127369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc74ad-239f-4de8-ad48-168a49df97b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:57.128254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc74ad-239f-4de8-ad48-168a49df97b0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:57.128506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc74ad-239f-4de8-ad48-168a49df97b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:57.128782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc74ad-239f-4de8-ad48-168a49df97b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:57.129448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc74ad-239f-4de8-ad48-168a49df97b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:57.130853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc74ad-239f-4de8-ad48-168a49df97b0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-15cc74ad-239f-4de8-ad48-168a49df97b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:57.143935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:57.145097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:57.151224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 532/1056] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jul 13 21:59:56 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:57.152114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78f8f0-e310-4723-8925-634730004568 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:57.258779 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78f8f0-e310-4723-8925-634730004568 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:57.292941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639da69-1d99-453c-96e7-73c80f93dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:57.293687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639da69-1d99-453c-96e7-73c80f93dbcc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:57.293886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639da69-1d99-453c-96e7-73c80f93dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:57.294163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639da69-1d99-453c-96e7-73c80f93dbcc None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:57.294865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639da69-1d99-453c-96e7-73c80f93dbcc None admin] RBAC: Adding query filter params (name=image) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:57.295170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639da69-1d99-453c-96e7-73c80f93dbcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:57.296609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639da69-1d99-453c-96e7-73c80f93dbcc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:57.303987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 525/1057] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:57.307118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc74ad-239f-4de8-ad48-168a49df97b0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:57.411639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc74ad-239f-4de8-ad48-168a49df97b0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:57.446851 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e05ddf-914b-4122-a361-31fe4376d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:57.447522 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e05ddf-914b-4122-a361-31fe4376d033 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:57.447807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e05ddf-914b-4122-a361-31fe4376d033 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:57.448109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e05ddf-914b-4122-a361-31fe4376d033 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:57.448814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e05ddf-914b-4122-a361-31fe4376d033 None admin] RBAC: Adding query filter params (type=image) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:57.449120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e05ddf-914b-4122-a361-31fe4376d033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:57.450473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e05ddf-914b-4122-a361-31fe4376d033 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:57.456174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 533/1058] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:57.461503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639da69-1d99-453c-96e7-73c80f93dbcc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:57.480396 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:57.567392 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639da69-1d99-453c-96e7-73c80f93dbcc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:57.569321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea99b-9a61-488f-92fc-ccb3b312c986 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:57.569617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea99b-9a61-488f-92fc-ccb3b312c986 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:57.569894 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea99b-9a61-488f-92fc-ccb3b312c986 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:57.571514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 534/1059] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 21:59:57.576352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daac60e-c7e2-40c9-bf5b-a01a6b04659d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:57.576640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daac60e-c7e2-40c9-bf5b-a01a6b04659d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:57.576914 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daac60e-c7e2-40c9-bf5b-a01a6b04659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:57.595729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8daac60e-c7e2-40c9-bf5b-a01a6b04659d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:57.597180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8daac60e-c7e2-40c9-bf5b-a01a6b04659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:57.607078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58a42a-f75f-4e3f-823f-71c5e107fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:57.607756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58a42a-f75f-4e3f-823f-71c5e107fe54 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:57.608522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58a42a-f75f-4e3f-823f-71c5e107fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:57.609357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58a42a-f75f-4e3f-823f-71c5e107fe54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:57.610131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58a42a-f75f-4e3f-823f-71c5e107fe54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:57.611495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58a42a-f75f-4e3f-823f-71c5e107fe54 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:57.638822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 526/1060] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 21:59:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 21:59:57.651880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:57.684580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 535/1061] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 21:59:57.708461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58a42a-f75f-4e3f-823f-71c5e107fe54 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:57.785917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:57.824052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58a42a-f75f-4e3f-823f-71c5e107fe54 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:57.859652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dac86d-633b-42f6-b2c8-b7ad305653b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:57.860509 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dac86d-633b-42f6-b2c8-b7ad305653b0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:57.860793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dac86d-633b-42f6-b2c8-b7ad305653b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:57.861068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dac86d-633b-42f6-b2c8-b7ad305653b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:57.871368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dac86d-633b-42f6-b2c8-b7ad305653b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-40dac86d-633b-42f6-b2c8-b7ad305653b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:57.879527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:57.880698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:57.881607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 527/1062] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 21:59:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:57.888609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daac60e-c7e2-40c9-bf5b-a01a6b04659d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:57.989656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daac60e-c7e2-40c9-bf5b-a01a6b04659d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:58.024268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a6e94-6866-4f79-892a-c26db5a828bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:58.024939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a6e94-6866-4f79-892a-c26db5a828bb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:58.025225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a6e94-6866-4f79-892a-c26db5a828bb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:58.025500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a6e94-6866-4f79-892a-c26db5a828bb None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:58.026250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a6e94-6866-4f79-892a-c26db5a828bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:58.026559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a6e94-6866-4f79-892a-c26db5a828bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:58.027934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a6e94-6866-4f79-892a-c26db5a828bb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:58.040460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 536/1063] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 21:59:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:58.041732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dac86d-633b-42f6-b2c8-b7ad305653b0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:58.150770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dac86d-633b-42f6-b2c8-b7ad305653b0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:58.181547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:58.188224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9426ff-3c3c-4736-824a-883f820c01ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:58.189022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9426ff-3c3c-4736-824a-883f820c01ae None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:58.189304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9426ff-3c3c-4736-824a-883f820c01ae None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:58.189580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9426ff-3c3c-4736-824a-883f820c01ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:58.201170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9426ff-3c3c-4736-824a-883f820c01ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:58.202729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9426ff-3c3c-4736-824a-883f820c01ae None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9c9426ff-3c3c-4736-824a-883f820c01ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:58.222152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:58.223143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:58.224089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:58.224089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:58.224089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:58.224089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:58.228283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 528/1064] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:58.229500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a6e94-6866-4f79-892a-c26db5a828bb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:58.268277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:58.335477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a6e94-6866-4f79-892a-c26db5a828bb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:58.369764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9950a-ce41-4ccd-85d8-643e077bed32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:58.370351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9950a-ce41-4ccd-85d8-643e077bed32 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:58.370636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9950a-ce41-4ccd-85d8-643e077bed32 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:58.370916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9950a-ce41-4ccd-85d8-643e077bed32 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:58.371641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9950a-ce41-4ccd-85d8-643e077bed32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:58.371974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9950a-ce41-4ccd-85d8-643e077bed32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:58.373342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9950a-ce41-4ccd-85d8-643e077bed32 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:58.389155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 537/1065] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:58.390943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9426ff-3c3c-4736-824a-883f820c01ae None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:58.490021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9426ff-3c3c-4736-824a-883f820c01ae None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:58.522568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f271dc-45a2-481e-903f-4613de333bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:58.523355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f271dc-45a2-481e-903f-4613de333bfc None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:58.523641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f271dc-45a2-481e-903f-4613de333bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:58.523933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f271dc-45a2-481e-903f-4613de333bfc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:58.531524 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f271dc-45a2-481e-903f-4613de333bfc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:58.532987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f271dc-45a2-481e-903f-4613de333bfc None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-28f271dc-45a2-481e-903f-4613de333bfc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 21:59:58.548292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:58.549261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:58.555106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 529/1066] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 21:59:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:58.555714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9950a-ce41-4ccd-85d8-643e077bed32 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:58.652158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:58.659300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9950a-ce41-4ccd-85d8-643e077bed32 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:58.693044 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abc51d-e2b6-482d-aba9-116938fb982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:58.693715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abc51d-e2b6-482d-aba9-116938fb982f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:58.694003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abc51d-e2b6-482d-aba9-116938fb982f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:58.694284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abc51d-e2b6-482d-aba9-116938fb982f None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:58.695123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abc51d-e2b6-482d-aba9-116938fb982f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:58.695436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abc51d-e2b6-482d-aba9-116938fb982f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:58.696896 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abc51d-e2b6-482d-aba9-116938fb982f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:58.719259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 538/1067] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 21:59:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:58.720583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f271dc-45a2-481e-903f-4613de333bfc None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:58.769950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:58.825690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f271dc-45a2-481e-903f-4613de333bfc None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:58.859954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc564607-f8f6-4f16-be42-afb962d8818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:58.860753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564607-f8f6-4f16-be42-afb962d8818a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:58.861039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564607-f8f6-4f16-be42-afb962d8818a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:58.861319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564607-f8f6-4f16-be42-afb962d8818a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:58.871629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc564607-f8f6-4f16-be42-afb962d8818a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:58.873097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc564607-f8f6-4f16-be42-afb962d8818a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-cc564607-f8f6-4f16-be42-afb962d8818a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 21:59:58.891012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:58.892269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:58.897715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 21:59:58.897715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 21:59:58.897715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 21:59:58.897715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:58.897715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 530/1068] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 21:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:58.899073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abc51d-e2b6-482d-aba9-116938fb982f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.000532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abc51d-e2b6-482d-aba9-116938fb982f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:59.034017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fa07f-cb17-427c-8a35-4001ab7aa16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:59.034676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa07f-cb17-427c-8a35-4001ab7aa16d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.034961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa07f-cb17-427c-8a35-4001ab7aa16d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.035240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa07f-cb17-427c-8a35-4001ab7aa16d None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.035985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fa07f-cb17-427c-8a35-4001ab7aa16d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:59.036297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fa07f-cb17-427c-8a35-4001ab7aa16d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:59.037657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fa07f-cb17-427c-8a35-4001ab7aa16d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:59.053982 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 539/1069] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 21:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:59.055222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc564607-f8f6-4f16-be42-afb962d8818a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.139589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06247d-9ccd-4061-8a36-9a2c7a417549 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.140703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06247d-9ccd-4061-8a36-9a2c7a417549 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.140935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06247d-9ccd-4061-8a36-9a2c7a417549 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.142513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 540/1070] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:59.147227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5c62-f624-425c-8c66-a3d7952c6544 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.147508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5c62-f624-425c-8c66-a3d7952c6544 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.147793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5c62-f624-425c-8c66-a3d7952c6544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.158159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:59.164742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc564607-f8f6-4f16-be42-afb962d8818a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:59.166249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0f9a5c62-f624-425c-8c66-a3d7952c6544 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:59.168437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0f9a5c62-f624-425c-8c66-a3d7952c6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:59.181826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:59.200579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e03b88-070b-446a-bbf8-0a2116c01cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:59.201378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03b88-070b-446a-bbf8-0a2116c01cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.201722 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03b88-070b-446a-bbf8-0a2116c01cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.201995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03b88-070b-446a-bbf8-0a2116c01cc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.209781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e03b88-070b-446a-bbf8-0a2116c01cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:59.211215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e03b88-070b-446a-bbf8-0a2116c01cc2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-06e03b88-070b-446a-bbf8-0a2116c01cc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 21:59:59.227832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:59.228958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:59.230142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 21:59:59.230142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 21:59:59.230142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 21:59:59.230142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 21:59:59.230142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 21:59:59.230142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 21:59:59.230142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 21:59:59.230142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 21:59:59.230142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 531/1071] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 21:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 21:59:59.234782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e03b88-070b-446a-bbf8-0a2116c01cc2 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.251620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 541/1072] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:59.274452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a5c62-f624-425c-8c66-a3d7952c6544 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.346729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e03b88-070b-446a-bbf8-0a2116c01cc2 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:59.376563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a5c62-f624-425c-8c66-a3d7952c6544 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:59.383176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a5aa0-b1c8-421c-8ab3-38b941b29487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:59.384001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a5aa0-b1c8-421c-8ab3-38b941b29487 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.384289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a5aa0-b1c8-421c-8ab3-38b941b29487 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.384569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a5aa0-b1c8-421c-8ab3-38b941b29487 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.385358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a5aa0-b1c8-421c-8ab3-38b941b29487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:59.385788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a5aa0-b1c8-421c-8ab3-38b941b29487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:59.387344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a5aa0-b1c8-421c-8ab3-38b941b29487 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:59.405374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 532/1073] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 21:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:59.406467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a5aa0-b1c8-421c-8ab3-38b941b29487 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.414697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2a09-eeb9-40cd-b3ec-136e65e63f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:59.415492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2a09-eeb9-40cd-b3ec-136e65e63f17 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.415783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2a09-eeb9-40cd-b3ec-136e65e63f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.416090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2a09-eeb9-40cd-b3ec-136e65e63f17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.426171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:59.427733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2a09-eeb9-40cd-b3ec-136e65e63f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-b78d2a09-eeb9-40cd-b3ec-136e65e63f17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 21:59:59.435533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 21:59:59.436509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 21:59:59.437424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 542/1074] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 21:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 21:59:59.442989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2a09-eeb9-40cd-b3ec-136e65e63f17 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.446596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:59.516024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a5aa0-b1c8-421c-8ab3-38b941b29487 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:59.549651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2a09-eeb9-40cd-b3ec-136e65e63f17 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:59.550730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e83b9-b3d7-46be-9718-1e644cde5b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:59.551713 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e83b9-b3d7-46be-9718-1e644cde5b19 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.552026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e83b9-b3d7-46be-9718-1e644cde5b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.552304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e83b9-b3d7-46be-9718-1e644cde5b19 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/44e6d786ac4a40468794b18cfedfa730/roles/7670d309329c458c8cdf908d84bd2fd6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.555327 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e83b9-b3d7-46be-9718-1e644cde5b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=44e6d786ac4a40468794b18cfedfa730, role_id=7670d309329c458c8cdf908d84bd2fd6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:59.556833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e83b9-b3d7-46be-9718-1e644cde5b19 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:59.579999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 533/1075] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:59 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/44e6d786ac4a40468794b18cfedfa730/roles/7670d309329c458c8cdf908d84bd2fd6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 21:59:59.600706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5f8d0-f92f-45ff-bf52-1603410b0669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:59.601406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5f8d0-f92f-45ff-bf52-1603410b0669 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.601696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5f8d0-f92f-45ff-bf52-1603410b0669 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.601979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5f8d0-f92f-45ff-bf52-1603410b0669 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.602756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5f8d0-f92f-45ff-bf52-1603410b0669 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 21:59:59.603072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5f8d0-f92f-45ff-bf52-1603410b0669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:59.604562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5f8d0-f92f-45ff-bf52-1603410b0669 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:59.619510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 543/1076] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 21:59:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:59.621131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e83b9-b3d7-46be-9718-1e644cde5b19 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.710258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:59.720464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cec2d-643b-43d1-ad8a-b7a6b3b0cd51 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.720464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cec2d-643b-43d1-ad8a-b7a6b3b0cd51 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.720738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cec2d-643b-43d1-ad8a-b7a6b3b0cd51 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.724079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 544/1077] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 21:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 21:59:59.727312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa64a1-711d-4bcb-a52a-d329c653d416 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.727612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa64a1-711d-4bcb-a52a-d329c653d416 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.727892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa64a1-711d-4bcb-a52a-d329c653d416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.745320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e83b9-b3d7-46be-9718-1e644cde5b19 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:59.750250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-38aa64a1-711d-4bcb-a52a-d329c653d416 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 21:59:59.751671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-38aa64a1-711d-4bcb-a52a-d329c653d416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 21:59:59.785071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c655ce-cf9c-4622-b9eb-2b8ca0bcff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:59.785891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c655ce-cf9c-4622-b9eb-2b8ca0bcff81 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.786181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c655ce-cf9c-4622-b9eb-2b8ca0bcff81 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.786468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c655ce-cf9c-4622-b9eb-2b8ca0bcff81 None admin] PATH_INFO: `/v3/users/cf28e1219f034e4d8c35997a38f480e2` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.787723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c655ce-cf9c-4622-b9eb-2b8ca0bcff81 None admin] RBAC: Authorizing `identity:get_user(user_id=cf28e1219f034e4d8c35997a38f480e2)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:59.789159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c655ce-cf9c-4622-b9eb-2b8ca0bcff81 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:59.790952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 534/1078] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 21:59:59 2022] GET /identity/v3/users/cf28e1219f034e4d8c35997a38f480e2 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 21:59:59.797240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c655ce-cf9c-4622-b9eb-2b8ca0bcff81 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.815568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:59.824994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 545/1079] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 21:59:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 21:59:59.847532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa64a1-711d-4bcb-a52a-d329c653d416 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.906384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c655ce-cf9c-4622-b9eb-2b8ca0bcff81 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:59.943491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014efd99-9bf0-4943-b522-937fbbbbba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:59.944513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014efd99-9bf0-4943-b522-937fbbbbba8e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.944805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014efd99-9bf0-4943-b522-937fbbbbba8e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.945086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014efd99-9bf0-4943-b522-937fbbbbba8e None admin] PATH_INFO: `/v3/projects/f24188ad9a394fa9a7553be91bbf380e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 21:59:59.946395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014efd99-9bf0-4943-b522-937fbbbbba8e None admin] RBAC: Authorizing `identity:get_project(project_id=f24188ad9a394fa9a7553be91bbf380e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 21:59:59.948084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014efd99-9bf0-4943-b522-937fbbbbba8e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 21:59:59.949631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa64a1-711d-4bcb-a52a-d329c653d416 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 21:59:59.954959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 535/1080] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 21:59:59 2022] GET /identity/v3/projects/f24188ad9a394fa9a7553be91bbf380e => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 21:59:59.956283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014efd99-9bf0-4943-b522-937fbbbbba8e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 21:59:59.971472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 21:59:59.985994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0690e55-2ebc-4a80-b8ed-0358e570f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 21:59:59.986908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0690e55-2ebc-4a80-b8ed-0358e570f716 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 21:59:59.987193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0690e55-2ebc-4a80-b8ed-0358e570f716 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 21:59:59.987471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0690e55-2ebc-4a80-b8ed-0358e570f716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:00.051528 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:00.058834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0690e55-2ebc-4a80-b8ed-0358e570f716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:00.060310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0690e55-2ebc-4a80-b8ed-0358e570f716 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:00.068318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014efd99-9bf0-4943-b522-937fbbbbba8e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:00.104537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d872-305c-4c84-bb90-9e37ca4a0ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:00.105442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d872-305c-4c84-bb90-9e37ca4a0ce1 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:00.105729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d872-305c-4c84-bb90-9e37ca4a0ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:00.106009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d872-305c-4c84-bb90-9e37ca4a0ce1 None admin] PATH_INFO: `/v3/projects/f24188ad9a394fa9a7553be91bbf380e/users/cf28e1219f034e4d8c35997a38f480e2/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:00.108083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727d872-305c-4c84-bb90-9e37ca4a0ce1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24188ad9a394fa9a7553be91bbf380e, user_id=cf28e1219f034e4d8c35997a38f480e2, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:00.110317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727d872-305c-4c84-bb90-9e37ca4a0ce1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:00.124797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 536/1081] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 21:59:59 2022] PUT /identity/v3/projects/f24188ad9a394fa9a7553be91bbf380e/users/cf28e1219f034e4d8c35997a38f480e2/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:00:00.178615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 546/1082] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 21:59:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 22:00:00.184711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d872-305c-4c84-bb90-9e37ca4a0ce1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:00.261229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:00.298166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d872-305c-4c84-bb90-9e37ca4a0ce1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:00.333304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564138d3-a29e-4bfa-b8aa-81076a81ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:00.334020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564138d3-a29e-4bfa-b8aa-81076a81ce95 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:00.334309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564138d3-a29e-4bfa-b8aa-81076a81ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:00.334590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564138d3-a29e-4bfa-b8aa-81076a81ce95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:00.345384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564138d3-a29e-4bfa-b8aa-81076a81ce95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:00.346823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564138d3-a29e-4bfa-b8aa-81076a81ce95 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-564138d3-a29e-4bfa-b8aa-81076a81ce95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:00:00.363930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:00.364847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:00.365729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:00:00.365729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:00:00.365729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:00:00.365729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:00.365729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 537/1083] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:00.372104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0690e55-2ebc-4a80-b8ed-0358e570f716 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:00.465639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:00.473491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0690e55-2ebc-4a80-b8ed-0358e570f716 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:00.506917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43988ed-641c-4c4a-9912-c9593a557610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:00.507575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43988ed-641c-4c4a-9912-c9593a557610 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:00.507860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43988ed-641c-4c4a-9912-c9593a557610 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:00.508162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43988ed-641c-4c4a-9912-c9593a557610 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:00.508892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43988ed-641c-4c4a-9912-c9593a557610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:00.509199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43988ed-641c-4c4a-9912-c9593a557610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:00.510556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43988ed-641c-4c4a-9912-c9593a557610 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:00.527937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 547/1084] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:01.620773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bd963-6c19-4997-a8cf-68af88443327 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:01.621320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bd963-6c19-4997-a8cf-68af88443327 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:01.621320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bd963-6c19-4997-a8cf-68af88443327 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:01.622706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 538/1085] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:01.628173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce7a52-014e-4c48-9817-23ec74a2c82e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:01.628583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce7a52-014e-4c48-9817-23ec74a2c82e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:01.628867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce7a52-014e-4c48-9817-23ec74a2c82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:01.646047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b1ce7a52-014e-4c48-9817-23ec74a2c82e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:01.647246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b1ce7a52-014e-4c48-9817-23ec74a2c82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:01.713243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 548/1086] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:01.737141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bd963-6c19-4997-a8cf-68af88443327 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:01.837788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bd963-6c19-4997-a8cf-68af88443327 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:01.861935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:01.872541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a7f07-bce6-4fa7-abf0-9c6b53cd9e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:01.873288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a7f07-bce6-4fa7-abf0-9c6b53cd9e6c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:01.873571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a7f07-bce6-4fa7-abf0-9c6b53cd9e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:01.873845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a7f07-bce6-4fa7-abf0-9c6b53cd9e6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:01.886411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a7f07-bce6-4fa7-abf0-9c6b53cd9e6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-485a7f07-bce6-4fa7-abf0-9c6b53cd9e6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:00:01.895012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:01.896153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:01.897000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 539/1087] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 22:00:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:01.902209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce7a52-014e-4c48-9817-23ec74a2c82e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:01.990923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:02.005910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce7a52-014e-4c48-9817-23ec74a2c82e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.038497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d898b6-43b8-4a3f-9eb3-b282451c9bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.039159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d898b6-43b8-4a3f-9eb3-b282451c9bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.039443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d898b6-43b8-4a3f-9eb3-b282451c9bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.039716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d898b6-43b8-4a3f-9eb3-b282451c9bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.040484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d898b6-43b8-4a3f-9eb3-b282451c9bb7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:02.040786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d898b6-43b8-4a3f-9eb3-b282451c9bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:02.042135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d898b6-43b8-4a3f-9eb3-b282451c9bb7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:02.050546 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 549/1088] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 22:00:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:02.056178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a7f07-bce6-4fa7-abf0-9c6b53cd9e6c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:02.154749 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53af32-3690-46cb-b88a-a019ec2f209c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.154960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53af32-3690-46cb-b88a-a019ec2f209c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.155245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53af32-3690-46cb-b88a-a019ec2f209c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.156898 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 550/1089] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:02.159178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a7f07-bce6-4fa7-abf0-9c6b53cd9e6c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.161638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d92d1a-48f7-4aac-8464-1b93180138cf None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.161929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d92d1a-48f7-4aac-8464-1b93180138cf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.162210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d92d1a-48f7-4aac-8464-1b93180138cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.178943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-06d92d1a-48f7-4aac-8464-1b93180138cf None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:02.180164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-06d92d1a-48f7-4aac-8464-1b93180138cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:02.192774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b3bba-8a28-4d89-8f86-1c1630d0c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.193567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3bba-8a28-4d89-8f86-1c1630d0c5ed None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.193851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3bba-8a28-4d89-8f86-1c1630d0c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.194127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3bba-8a28-4d89-8f86-1c1630d0c5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.204546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b3bba-8a28-4d89-8f86-1c1630d0c5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:02.206249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b3bba-8a28-4d89-8f86-1c1630d0c5ed None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-f23b3bba-8a28-4d89-8f86-1c1630d0c5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:00:02.223129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:02.224178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:02.225231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:00:02.225231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:00:02.225231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:00:02.225231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:02.225231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 540/1090] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 22:00:02.230235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b3bba-8a28-4d89-8f86-1c1630d0c5ed None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:02.252225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 551/1091] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 22:00:02.268496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:02.275942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d92d1a-48f7-4aac-8464-1b93180138cf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:02.340116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b3bba-8a28-4d89-8f86-1c1630d0c5ed None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.353502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:02.375827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2542e27-e4cc-4066-a189-52a8ff2c3d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.376021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d92d1a-48f7-4aac-8464-1b93180138cf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.376525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2542e27-e4cc-4066-a189-52a8ff2c3d26 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.376815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2542e27-e4cc-4066-a189-52a8ff2c3d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.377100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2542e27-e4cc-4066-a189-52a8ff2c3d26 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.377826 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2542e27-e4cc-4066-a189-52a8ff2c3d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:02.378138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2542e27-e4cc-4066-a189-52a8ff2c3d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:02.379499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2542e27-e4cc-4066-a189-52a8ff2c3d26 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:02.391219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 541/1092] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:02.396684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2542e27-e4cc-4066-a189-52a8ff2c3d26 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:02.409583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbce757-52ba-4301-a167-799eb0bdffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.410322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbce757-52ba-4301-a167-799eb0bdffa8 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.410609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbce757-52ba-4301-a167-799eb0bdffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.410895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbce757-52ba-4301-a167-799eb0bdffa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.421840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbce757-52ba-4301-a167-799eb0bdffa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-2cbce757-52ba-4301-a167-799eb0bdffa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:00:02.429539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:02.430486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:00:02.431458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 552/1093] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:00:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 22:00:02.436583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbce757-52ba-4301-a167-799eb0bdffa8 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:02.488887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:02.495442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2542e27-e4cc-4066-a189-52a8ff2c3d26 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.529526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ae7b-ad9f-4e42-932c-85f6c4f09547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.530868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ae7b-ad9f-4e42-932c-85f6c4f09547 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.531309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ae7b-ad9f-4e42-932c-85f6c4f09547 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.531599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ae7b-ad9f-4e42-932c-85f6c4f09547 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.537354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbce757-52ba-4301-a167-799eb0bdffa8 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.538595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1ae7b-ad9f-4e42-932c-85f6c4f09547 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:02.540082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1ae7b-ad9f-4e42-932c-85f6c4f09547 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a5c1ae7b-ad9f-4e42-932c-85f6c4f09547 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 22:00:02.554957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:02.556195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:02.557181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 542/1094] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 22:00:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 22:00:02.561877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ae7b-ad9f-4e42-932c-85f6c4f09547 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:02.574355 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74ebe-9c46-41c3-a639-bdfe9c1fe4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.575017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74ebe-9c46-41c3-a639-bdfe9c1fe4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.575300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74ebe-9c46-41c3-a639-bdfe9c1fe4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.575575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74ebe-9c46-41c3-a639-bdfe9c1fe4d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.576347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e74ebe-9c46-41c3-a639-bdfe9c1fe4d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:02.576650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e74ebe-9c46-41c3-a639-bdfe9c1fe4d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:02.578106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e74ebe-9c46-41c3-a639-bdfe9c1fe4d4 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:02.583252 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:02.587142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 553/1095] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:00:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:02.593319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74ebe-9c46-41c3-a639-bdfe9c1fe4d4 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:02.661116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ae7b-ad9f-4e42-932c-85f6c4f09547 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.693727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74ebe-9c46-41c3-a639-bdfe9c1fe4d4 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.695562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51db80-7085-4161-9b74-7e53a9408f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.696275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51db80-7085-4161-9b74-7e53a9408f5e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.696559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51db80-7085-4161-9b74-7e53a9408f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.696837 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51db80-7085-4161-9b74-7e53a9408f5e None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.697669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51db80-7085-4161-9b74-7e53a9408f5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:02.697979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51db80-7085-4161-9b74-7e53a9408f5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:02.699389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51db80-7085-4161-9b74-7e53a9408f5e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:02.717032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 543/1096] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 22:00:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:02.722739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51db80-7085-4161-9b74-7e53a9408f5e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:02.729081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c47f1-7be0-435b-9455-e93ffd69cefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.729955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c47f1-7be0-435b-9455-e93ffd69cefe None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.730245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c47f1-7be0-435b-9455-e93ffd69cefe None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.730527 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c47f1-7be0-435b-9455-e93ffd69cefe None admin] PATH_INFO: `/v3/users/cf28e1219f034e4d8c35997a38f480e2` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.731750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c47f1-7be0-435b-9455-e93ffd69cefe None admin] RBAC: Authorizing `identity:get_user(user_id=cf28e1219f034e4d8c35997a38f480e2)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:02.733204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c47f1-7be0-435b-9455-e93ffd69cefe None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:02.734887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 554/1097] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:02 2022] GET /identity/v3/users/cf28e1219f034e4d8c35997a38f480e2 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:02.737946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:02.740372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c47f1-7be0-435b-9455-e93ffd69cefe None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:02.804846 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:02.823144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51db80-7085-4161-9b74-7e53a9408f5e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.839098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c47f1-7be0-435b-9455-e93ffd69cefe None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:02.855812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b73f-58d7-42dc-9d05-8884084d424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.856482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b73f-58d7-42dc-9d05-8884084d424c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.856764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b73f-58d7-42dc-9d05-8884084d424c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.857039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b73f-58d7-42dc-9d05-8884084d424c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.872033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464a034-f0e6-4e60-9f84-025085cebf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:02.872683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464a034-f0e6-4e60-9f84-025085cebf4e None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:02.872974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464a034-f0e6-4e60-9f84-025085cebf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:02.873259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464a034-f0e6-4e60-9f84-025085cebf4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:02.922838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281b73f-58d7-42dc-9d05-8884084d424c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:02.924248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281b73f-58d7-42dc-9d05-8884084d424c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:02.938579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:02.939744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464a034-f0e6-4e60-9f84-025085cebf4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:02.941704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464a034-f0e6-4e60-9f84-025085cebf4e None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:03.005284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:03.021060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 544/1098] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:00:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 22:00:03.026682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b73f-58d7-42dc-9d05-8884084d424c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:03.044850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 555/1099] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:00:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 22:00:03.046533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464a034-f0e6-4e60-9f84-025085cebf4e None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:03.127260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b73f-58d7-42dc-9d05-8884084d424c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:03.140887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:03.144303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464a034-f0e6-4e60-9f84-025085cebf4e None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:03.161272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfd878-8939-464b-8f42-69838c948997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:03.162294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfd878-8939-464b-8f42-69838c948997 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:03.162579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfd878-8939-464b-8f42-69838c948997 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:03.162857 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfd878-8939-464b-8f42-69838c948997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:03.173476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfd878-8939-464b-8f42-69838c948997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:03.174849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfd878-8939-464b-8f42-69838c948997 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:03.179158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb142b-9a8c-4301-82a1-e9c3c342a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:03.180055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb142b-9a8c-4301-82a1-e9c3c342a645 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:03.180348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb142b-9a8c-4301-82a1-e9c3c342a645 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:03.180631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb142b-9a8c-4301-82a1-e9c3c342a645 None admin] PATH_INFO: `/v3/projects/f24188ad9a394fa9a7553be91bbf380e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:03.181818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb142b-9a8c-4301-82a1-e9c3c342a645 None admin] RBAC: Authorizing `identity:get_project(project_id=f24188ad9a394fa9a7553be91bbf380e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:03.183229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb142b-9a8c-4301-82a1-e9c3c342a645 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:03.184975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 556/1100] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:03 2022] GET /identity/v3/projects/f24188ad9a394fa9a7553be91bbf380e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:03.191523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb142b-9a8c-4301-82a1-e9c3c342a645 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-72dfd878-8939-464b-8f42-69838c948997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:00:03.192693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:03.193705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:03.194951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:00:03.194951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:00:03.194951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:00:03.194951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:03.194951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 545/1101] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 22:00:03.199246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfd878-8939-464b-8f42-69838c948997 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:03.228127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:03.291686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb142b-9a8c-4301-82a1-e9c3c342a645 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:03.298113 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfd878-8939-464b-8f42-69838c948997 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:03.325778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e25de-961f-4b6e-abd1-583dfc47720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:03.326449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e25de-961f-4b6e-abd1-583dfc47720b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:03.326736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e25de-961f-4b6e-abd1-583dfc47720b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:03.327018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e25de-961f-4b6e-abd1-583dfc47720b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:03.327942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e25de-961f-4b6e-abd1-583dfc47720b None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=f24188ad9a394fa9a7553be91bbf380e, user.id=cf28e1219f034e4d8c35997a38f480e2) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:03.328258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e25de-961f-4b6e-abd1-583dfc47720b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:03.329688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e25de-961f-4b6e-abd1-583dfc47720b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:03.332175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd67976-2d72-4909-bd58-ac1c9aba5142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:03.332837 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd67976-2d72-4909-bd58-ac1c9aba5142 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:03.333124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd67976-2d72-4909-bd58-ac1c9aba5142 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:03.333403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd67976-2d72-4909-bd58-ac1c9aba5142 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:03.334122 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd67976-2d72-4909-bd58-ac1c9aba5142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:03.334548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd67976-2d72-4909-bd58-ac1c9aba5142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:03.335687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 557/1102] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:00:03 2022] GET /identity/v3/role_assignments?user.id=cf28e1219f034e4d8c35997a38f480e2&scope.project.id=f24188ad9a394fa9a7553be91bbf380e&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:03.335893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd67976-2d72-4909-bd58-ac1c9aba5142 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:03.348856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 546/1103] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:03.354571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e25de-961f-4b6e-abd1-583dfc47720b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:03.457039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:03.460071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e25de-961f-4b6e-abd1-583dfc47720b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:03.496434 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e1b61-ee95-4cf8-a08f-00cfa5ca6eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:03.497231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1b61-ee95-4cf8-a08f-00cfa5ca6eab None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:03.497515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1b61-ee95-4cf8-a08f-00cfa5ca6eab None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:03.497793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1b61-ee95-4cf8-a08f-00cfa5ca6eab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:03.504816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e1b61-ee95-4cf8-a08f-00cfa5ca6eab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:03.506256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e1b61-ee95-4cf8-a08f-00cfa5ca6eab None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-851e1b61-ee95-4cf8-a08f-00cfa5ca6eab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 22:00:03.520547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:03.521429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:03.522519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 22:00:03.522519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 22:00:03.522519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 22:00:03.522519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 22:00:03.522519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 22:00:03.522519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 22:00:03.522519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:00:03.522519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:00:03.522519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 558/1104] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 22:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:03.527602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd67976-2d72-4909-bd58-ac1c9aba5142 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:03.559257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:03.630780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd67976-2d72-4909-bd58-ac1c9aba5142 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:03.664996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ac2b6-01b3-4481-a48a-78b340648f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:03.665658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac2b6-01b3-4481-a48a-78b340648f70 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:03.665933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac2b6-01b3-4481-a48a-78b340648f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:03.666213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac2b6-01b3-4481-a48a-78b340648f70 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:03.667004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ac2b6-01b3-4481-a48a-78b340648f70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:03.667319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ac2b6-01b3-4481-a48a-78b340648f70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:03.668789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ac2b6-01b3-4481-a48a-78b340648f70 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:03.682318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 547/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 22:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:03.689320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e1b61-ee95-4cf8-a08f-00cfa5ca6eab None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:03.788181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e1b61-ee95-4cf8-a08f-00cfa5ca6eab None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:03.821973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da04d5-3814-4b1f-9dfe-9374b3e10ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:03.822629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da04d5-3814-4b1f-9dfe-9374b3e10ddd None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:03.822913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da04d5-3814-4b1f-9dfe-9374b3e10ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:03.823189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da04d5-3814-4b1f-9dfe-9374b3e10ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:03.824049 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da04d5-3814-4b1f-9dfe-9374b3e10ddd None admin] RBAC: Adding query filter params (role.id=7670d309329c458c8cdf908d84bd2fd6, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=44e6d786ac4a40468794b18cfedfa730) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:03.824364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da04d5-3814-4b1f-9dfe-9374b3e10ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:03.825784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da04d5-3814-4b1f-9dfe-9374b3e10ddd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:03.839935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 559/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:00:03 2022] GET /identity/v3/role_assignments?user.id=44e6d786ac4a40468794b18cfedfa730&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=7670d309329c458c8cdf908d84bd2fd6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:05.399565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802ffd-40db-4111-a20c-b93a9cdd64c2 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:05.400114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802ffd-40db-4111-a20c-b93a9cdd64c2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:05.400114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802ffd-40db-4111-a20c-b93a9cdd64c2 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:05.401444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 548/1107] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:05.407147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb8d7-d484-49f4-a280-9ac84cb92099 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:05.407521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb8d7-d484-49f4-a280-9ac84cb92099 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:05.407716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb8d7-d484-49f4-a280-9ac84cb92099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:05.424601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-250cb8d7-d484-49f4-a280-9ac84cb92099 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:05.425792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-250cb8d7-d484-49f4-a280-9ac84cb92099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:05.442621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:05.491448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 560/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:05.516452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802ffd-40db-4111-a20c-b93a9cdd64c2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:05.598225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:05.613693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802ffd-40db-4111-a20c-b93a9cdd64c2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:05.646602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540e1f-7bca-4992-b350-004affc95fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:05.647380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540e1f-7bca-4992-b350-004affc95fee None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:05.647660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540e1f-7bca-4992-b350-004affc95fee None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:05.647963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540e1f-7bca-4992-b350-004affc95fee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:05.649114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f540e1f-7bca-4992-b350-004affc95fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:05.650569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f540e1f-7bca-4992-b350-004affc95fee None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:05.652130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 549/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:00:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:05.658875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cb8d7-d484-49f4-a280-9ac84cb92099 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:05.755100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cb8d7-d484-49f4-a280-9ac84cb92099 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:05.788685 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004df374-6820-4dab-99b0-dcdd04c4d4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:05.789352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df374-6820-4dab-99b0-dcdd04c4d4c0 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:05.789641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df374-6820-4dab-99b0-dcdd04c4d4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:05.789924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df374-6820-4dab-99b0-dcdd04c4d4c0 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:05.790644 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004df374-6820-4dab-99b0-dcdd04c4d4c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:05.792678 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004df374-6820-4dab-99b0-dcdd04c4d4c0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:05.813870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 561/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 22:00:05 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:00:07.870772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434f60-2b80-4f47-822e-f0571df0be9b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:07.871411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434f60-2b80-4f47-822e-f0571df0be9b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:07.871411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434f60-2b80-4f47-822e-f0571df0be9b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:07.872725 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 550/1111] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:07.878409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c77f1f-1b8b-4c50-a3e6-ecc69545330b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:07.878849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c77f1f-1b8b-4c50-a3e6-ecc69545330b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:07.878959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c77f1f-1b8b-4c50-a3e6-ecc69545330b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:07.895848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-55c77f1f-1b8b-4c50-a3e6-ecc69545330b None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:07.897061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-55c77f1f-1b8b-4c50-a3e6-ecc69545330b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:07.899914 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:07.966917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 562/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:07.990652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434f60-2b80-4f47-822e-f0571df0be9b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:08.091661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434f60-2b80-4f47-822e-f0571df0be9b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:08.126017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17672a5e-478a-416c-97f7-5b50385124fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:08.126805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17672a5e-478a-416c-97f7-5b50385124fe None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:08.127092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17672a5e-478a-416c-97f7-5b50385124fe None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:08.127371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17672a5e-478a-416c-97f7-5b50385124fe None admin] PATH_INFO: `/v3/roles/61fdd4e4d3c546ec97b97285ad1f80cd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:08.128868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17672a5e-478a-416c-97f7-5b50385124fe None admin] RBAC: Authorizing `identity:get_role(role_id=61fdd4e4d3c546ec97b97285ad1f80cd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:08.130249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17672a5e-478a-416c-97f7-5b50385124fe None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:08.131626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 551/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:07 2022] GET /identity/v3/roles/61fdd4e4d3c546ec97b97285ad1f80cd => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:08.137448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c77f1f-1b8b-4c50-a3e6-ecc69545330b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:08.233590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c77f1f-1b8b-4c50-a3e6-ecc69545330b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:08.266262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc38b-2e11-4bcf-9e6c-08c2b9ab7b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:08.267120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc38b-2e11-4bcf-9e6c-08c2b9ab7b5a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:08.267404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc38b-2e11-4bcf-9e6c-08c2b9ab7b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:08.267684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc38b-2e11-4bcf-9e6c-08c2b9ab7b5a None admin] PATH_INFO: `/v3/users/e2dc26efd9094004b8ca7524b56a8ebf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:08.277491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:08.281626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bc38b-2e11-4bcf-9e6c-08c2b9ab7b5a None admin] RBAC: Authorizing `identity:get_user(user_id=e2dc26efd9094004b8ca7524b56a8ebf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:08.283055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bc38b-2e11-4bcf-9e6c-08c2b9ab7b5a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:08.284727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 563/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:08 2022] GET /identity/v3/users/e2dc26efd9094004b8ca7524b56a8ebf => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:08.290296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17672a5e-478a-416c-97f7-5b50385124fe None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:08.313615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:08.387273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17672a5e-478a-416c-97f7-5b50385124fe None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:08.419118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6796dc-c1da-428b-bdbe-89e7c85a3037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:08.419761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6796dc-c1da-428b-bdbe-89e7c85a3037 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:08.420076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6796dc-c1da-428b-bdbe-89e7c85a3037 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:08.420359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6796dc-c1da-428b-bdbe-89e7c85a3037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:08.485213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6796dc-c1da-428b-bdbe-89e7c85a3037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:08.486629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6796dc-c1da-428b-bdbe-89e7c85a3037 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:08.508750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:08.581403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 552/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:00:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:00:08.587292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc38b-2e11-4bcf-9e6c-08c2b9ab7b5a None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:08.690269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bc38b-2e11-4bcf-9e6c-08c2b9ab7b5a None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:08.723368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f653bf-a0bc-4f9c-89dc-859e534ea08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:08.724250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f653bf-a0bc-4f9c-89dc-859e534ea08a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:08.724542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f653bf-a0bc-4f9c-89dc-859e534ea08a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:08.724825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f653bf-a0bc-4f9c-89dc-859e534ea08a None admin] PATH_INFO: `/v3/projects/f24188ad9a394fa9a7553be91bbf380e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:08.726008 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f653bf-a0bc-4f9c-89dc-859e534ea08a None admin] RBAC: Authorizing `identity:get_project(project_id=f24188ad9a394fa9a7553be91bbf380e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:08.727432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f653bf-a0bc-4f9c-89dc-859e534ea08a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:08.729171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 564/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:08 2022] GET /identity/v3/projects/f24188ad9a394fa9a7553be91bbf380e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:08.735293 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6796dc-c1da-428b-bdbe-89e7c85a3037 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:08.832048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6796dc-c1da-428b-bdbe-89e7c85a3037 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:08.853363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:08.865188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b0a4b-2048-4f18-a9fc-9f9abda42349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:08.865839 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b0a4b-2048-4f18-a9fc-9f9abda42349 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:08.866126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b0a4b-2048-4f18-a9fc-9f9abda42349 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:08.866403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b0a4b-2048-4f18-a9fc-9f9abda42349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:08.867235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b0a4b-2048-4f18-a9fc-9f9abda42349 None admin] RBAC: Adding query filter params (role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=f24188ad9a394fa9a7553be91bbf380e, user.id=e2dc26efd9094004b8ca7524b56a8ebf) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:08.867549 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b0a4b-2048-4f18-a9fc-9f9abda42349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:08.869002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b0a4b-2048-4f18-a9fc-9f9abda42349 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:08.874366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 553/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:00:08 2022] GET /identity/v3/role_assignments?user.id=e2dc26efd9094004b8ca7524b56a8ebf&scope.project.id=f24188ad9a394fa9a7553be91bbf380e&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:10.897114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790432fc-bcfe-4d21-96f3-c2b927bf93d5 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:10.897668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790432fc-bcfe-4d21-96f3-c2b927bf93d5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:10.897668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790432fc-bcfe-4d21-96f3-c2b927bf93d5 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:10.899056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 565/1118] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:10.904158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d52a4-f8ef-4131-a852-cdce795e588d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:10.904557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d52a4-f8ef-4131-a852-cdce795e588d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:10.905246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d52a4-f8ef-4131-a852-cdce795e588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:10.923051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ee0d52a4-f8ef-4131-a852-cdce795e588d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:10.924270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ee0d52a4-f8ef-4131-a852-cdce795e588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:10.988246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 554/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:11.011146 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790432fc-bcfe-4d21-96f3-c2b927bf93d5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:11.074800 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:11.109972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790432fc-bcfe-4d21-96f3-c2b927bf93d5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:11.144171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6cd54-4429-4608-b24b-02275021418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:11.145016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6cd54-4429-4608-b24b-02275021418c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:11.145296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6cd54-4429-4608-b24b-02275021418c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:11.145572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6cd54-4429-4608-b24b-02275021418c None admin] PATH_INFO: `/v3/roles/61fdd4e4d3c546ec97b97285ad1f80cd` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:11.147024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6cd54-4429-4608-b24b-02275021418c None admin] RBAC: Authorizing `identity:get_role(role_id=61fdd4e4d3c546ec97b97285ad1f80cd)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:11.148458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6cd54-4429-4608-b24b-02275021418c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:11.149762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 566/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:11 2022] GET /identity/v3/roles/61fdd4e4d3c546ec97b97285ad1f80cd => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:11.155724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d52a4-f8ef-4131-a852-cdce795e588d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:11.251477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d52a4-f8ef-4131-a852-cdce795e588d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:11.267194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:11.284272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6e0b5-da83-406f-986a-6c6afee0f500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:11.285136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6e0b5-da83-406f-986a-6c6afee0f500 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:11.285419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6e0b5-da83-406f-986a-6c6afee0f500 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:11.285696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6e0b5-da83-406f-986a-6c6afee0f500 None admin] PATH_INFO: `/v3/users/e2dc26efd9094004b8ca7524b56a8ebf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:11.286868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6e0b5-da83-406f-986a-6c6afee0f500 None admin] RBAC: Authorizing `identity:get_user(user_id=e2dc26efd9094004b8ca7524b56a8ebf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:11.288327 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6e0b5-da83-406f-986a-6c6afee0f500 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:11.289947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 555/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:11 2022] GET /identity/v3/users/e2dc26efd9094004b8ca7524b56a8ebf => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:11.296582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6cd54-4429-4608-b24b-02275021418c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:11.392272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6cd54-4429-4608-b24b-02275021418c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:11.424803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749ddd7-6345-480e-a121-e25e99d0f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:11.425583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749ddd7-6345-480e-a121-e25e99d0f074 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:11.425867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749ddd7-6345-480e-a121-e25e99d0f074 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:11.426143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749ddd7-6345-480e-a121-e25e99d0f074 None admin] PATH_INFO: `/v3/projects/f24188ad9a394fa9a7553be91bbf380e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:11.427297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749ddd7-6345-480e-a121-e25e99d0f074 None admin] RBAC: Authorizing `identity:get_project(project_id=f24188ad9a394fa9a7553be91bbf380e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:11.428726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749ddd7-6345-480e-a121-e25e99d0f074 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:11.430384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 567/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:11 2022] GET /identity/v3/projects/f24188ad9a394fa9a7553be91bbf380e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:11.436820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6e0b5-da83-406f-986a-6c6afee0f500 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:11.532253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6e0b5-da83-406f-986a-6c6afee0f500 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:11.564761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e40ffe-54a3-40fe-b220-fd8e9f084717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:11.565625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40ffe-54a3-40fe-b220-fd8e9f084717 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:11.565913 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40ffe-54a3-40fe-b220-fd8e9f084717 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:11.566194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40ffe-54a3-40fe-b220-fd8e9f084717 None admin] PATH_INFO: `/v3/projects/f24188ad9a394fa9a7553be91bbf380e/users/e2dc26efd9094004b8ca7524b56a8ebf/roles/61fdd4e4d3c546ec97b97285ad1f80cd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:11.568397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e40ffe-54a3-40fe-b220-fd8e9f084717 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24188ad9a394fa9a7553be91bbf380e, user_id=e2dc26efd9094004b8ca7524b56a8ebf, role_id=61fdd4e4d3c546ec97b97285ad1f80cd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:11.569812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e40ffe-54a3-40fe-b220-fd8e9f084717 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:11.582222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 556/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 22:00:11 2022] PUT /identity/v3/projects/f24188ad9a394fa9a7553be91bbf380e/users/e2dc26efd9094004b8ca7524b56a8ebf/roles/61fdd4e4d3c546ec97b97285ad1f80cd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:00:13.564520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa1df2-2169-4197-a8ba-5a9c94b5f07c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:13.565046 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa1df2-2169-4197-a8ba-5a9c94b5f07c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:13.565046 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa1df2-2169-4197-a8ba-5a9c94b5f07c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:13.566442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 568/1124] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:13.571506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e563c2-ff5e-45ac-98d9-76050b465ca1 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:13.571941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e563c2-ff5e-45ac-98d9-76050b465ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:13.572107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e563c2-ff5e-45ac-98d9-76050b465ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:13.589762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-11e563c2-ff5e-45ac-98d9-76050b465ca1 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:13.590953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-11e563c2-ff5e-45ac-98d9-76050b465ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:13.632220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:13.659071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 557/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:13.682625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa1df2-2169-4197-a8ba-5a9c94b5f07c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:13.685495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:13.781021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa1df2-2169-4197-a8ba-5a9c94b5f07c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:13.813725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f80266-b14a-4a92-8455-a4b383267131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:13.814618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f80266-b14a-4a92-8455-a4b383267131 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:13.814849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f80266-b14a-4a92-8455-a4b383267131 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:13.815121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f80266-b14a-4a92-8455-a4b383267131 None admin] PATH_INFO: `/v3/roles/61fdd4e4d3c546ec97b97285ad1f80cd` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:13.816605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f80266-b14a-4a92-8455-a4b383267131 None admin] RBAC: Authorizing `identity:get_role(role_id=61fdd4e4d3c546ec97b97285ad1f80cd)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:13.817953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f80266-b14a-4a92-8455-a4b383267131 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:13.819316 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 569/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:13 2022] GET /identity/v3/roles/61fdd4e4d3c546ec97b97285ad1f80cd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:13.825320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e563c2-ff5e-45ac-98d9-76050b465ca1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:13.921476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e563c2-ff5e-45ac-98d9-76050b465ca1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:13.953641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479d1b5-f7c6-477f-94a3-e2b392bbacda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:13.954544 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479d1b5-f7c6-477f-94a3-e2b392bbacda None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:13.954828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479d1b5-f7c6-477f-94a3-e2b392bbacda None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:13.955359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479d1b5-f7c6-477f-94a3-e2b392bbacda None admin] PATH_INFO: `/v3/users/e2dc26efd9094004b8ca7524b56a8ebf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:13.956537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479d1b5-f7c6-477f-94a3-e2b392bbacda None admin] RBAC: Authorizing `identity:get_user(user_id=e2dc26efd9094004b8ca7524b56a8ebf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:13.957953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479d1b5-f7c6-477f-94a3-e2b392bbacda None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:13.959559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 558/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:13 2022] GET /identity/v3/users/e2dc26efd9094004b8ca7524b56a8ebf => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:13.965161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f80266-b14a-4a92-8455-a4b383267131 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:14.032497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:14.064009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f80266-b14a-4a92-8455-a4b383267131 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:14.097331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc9c92-4e0d-4205-aac7-d0aff52bfe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:14.097905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc9c92-4e0d-4205-aac7-d0aff52bfe33 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:14.098187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc9c92-4e0d-4205-aac7-d0aff52bfe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:14.098461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc9c92-4e0d-4205-aac7-d0aff52bfe33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:14.163909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc9c92-4e0d-4205-aac7-d0aff52bfe33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:14.165379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc9c92-4e0d-4205-aac7-d0aff52bfe33 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:14.235242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:14.267833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 570/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:00:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:00:14.273693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479d1b5-f7c6-477f-94a3-e2b392bbacda None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:14.315478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:14.371062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479d1b5-f7c6-477f-94a3-e2b392bbacda None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:14.403730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28beb02c-ba68-4f1a-8e65-f9e57928bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:14.404638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beb02c-ba68-4f1a-8e65-f9e57928bf70 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:14.405122 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beb02c-ba68-4f1a-8e65-f9e57928bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:14.405233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beb02c-ba68-4f1a-8e65-f9e57928bf70 None admin] PATH_INFO: `/v3/projects/f24188ad9a394fa9a7553be91bbf380e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:14.406347 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28beb02c-ba68-4f1a-8e65-f9e57928bf70 None admin] RBAC: Authorizing `identity:get_project(project_id=f24188ad9a394fa9a7553be91bbf380e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:14.407768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28beb02c-ba68-4f1a-8e65-f9e57928bf70 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:14.409468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 559/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:14 2022] GET /identity/v3/projects/f24188ad9a394fa9a7553be91bbf380e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:14.415419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc9c92-4e0d-4205-aac7-d0aff52bfe33 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:14.514011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc9c92-4e0d-4205-aac7-d0aff52bfe33 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:14.548418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103829-fda4-4166-9b82-f38cb875210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:14.549054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103829-fda4-4166-9b82-f38cb875210b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:14.549342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103829-fda4-4166-9b82-f38cb875210b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:14.549621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103829-fda4-4166-9b82-f38cb875210b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:14.550608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103829-fda4-4166-9b82-f38cb875210b None admin] RBAC: Adding query filter params (role.id=61fdd4e4d3c546ec97b97285ad1f80cd, scope.project.id=f24188ad9a394fa9a7553be91bbf380e, user.id=e2dc26efd9094004b8ca7524b56a8ebf) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:14.550928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103829-fda4-4166-9b82-f38cb875210b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:14.552379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103829-fda4-4166-9b82-f38cb875210b None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:14.558280 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 571/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:00:14 2022] GET /identity/v3/role_assignments?user.id=e2dc26efd9094004b8ca7524b56a8ebf&scope.project.id=f24188ad9a394fa9a7553be91bbf380e&role.id=61fdd4e4d3c546ec97b97285ad1f80cd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:16.583199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565128f5-f14e-4edb-9725-1d1168ed8155 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:16.583739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565128f5-f14e-4edb-9725-1d1168ed8155 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:16.583846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565128f5-f14e-4edb-9725-1d1168ed8155 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:16.585183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 560/1131] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:16.590162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79dc34-342b-40a2-9bb2-073841120a57 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:16.590565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79dc34-342b-40a2-9bb2-073841120a57 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:16.590722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79dc34-342b-40a2-9bb2-073841120a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:16.607883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8c79dc34-342b-40a2-9bb2-073841120a57 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:16.609081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8c79dc34-342b-40a2-9bb2-073841120a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:16.633792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:16.673399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 572/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:16.696209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565128f5-f14e-4edb-9725-1d1168ed8155 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:16.795793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565128f5-f14e-4edb-9725-1d1168ed8155 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:16.805886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:16.828462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a0858-a9b2-4714-b17c-2c7d8aae2599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:16.829236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0858-a9b2-4714-b17c-2c7d8aae2599 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:16.829523 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0858-a9b2-4714-b17c-2c7d8aae2599 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:16.829802 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0858-a9b2-4714-b17c-2c7d8aae2599 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:16.831230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a0858-a9b2-4714-b17c-2c7d8aae2599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:16.832689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a0858-a9b2-4714-b17c-2c7d8aae2599 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:16.834346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 561/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:00:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:16.840159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79dc34-342b-40a2-9bb2-073841120a57 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:16.935279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79dc34-342b-40a2-9bb2-073841120a57 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:16.968025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601b2d7-1c5f-4b48-802a-2b68b438fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:16.968671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601b2d7-1c5f-4b48-802a-2b68b438fb2f None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:16.968956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601b2d7-1c5f-4b48-802a-2b68b438fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:16.969232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601b2d7-1c5f-4b48-802a-2b68b438fb2f None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:16.969931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601b2d7-1c5f-4b48-802a-2b68b438fb2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:16.971384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601b2d7-1c5f-4b48-802a-2b68b438fb2f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:16.996212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 573/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 22:00:16 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:00:19.026597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1de5-1a55-4b6b-98ec-5ee1c50b9913 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:19.027130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1de5-1a55-4b6b-98ec-5ee1c50b9913 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:19.027252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1de5-1a55-4b6b-98ec-5ee1c50b9913 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:19.028589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 562/1135] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:19.034123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37560ce-1087-46ca-92ab-7d90de5e2699 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:19.034524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37560ce-1087-46ca-92ab-7d90de5e2699 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:19.034687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37560ce-1087-46ca-92ab-7d90de5e2699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:19.051569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e37560ce-1087-46ca-92ab-7d90de5e2699 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:19.052785 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e37560ce-1087-46ca-92ab-7d90de5e2699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:19.063071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:19.118840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 574/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:19.144260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c1de5-1a55-4b6b-98ec-5ee1c50b9913 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:19.241832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c1de5-1a55-4b6b-98ec-5ee1c50b9913 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:19.274741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5aaab-23df-42e4-9fc3-93a774e4f6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:19.275521 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5aaab-23df-42e4-9fc3-93a774e4f6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:19.275833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5aaab-23df-42e4-9fc3-93a774e4f6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:19.276138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5aaab-23df-42e4-9fc3-93a774e4f6f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:19.277359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5aaab-23df-42e4-9fc3-93a774e4f6f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:19.278707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5aaab-23df-42e4-9fc3-93a774e4f6f2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:19.280874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 563/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:19.286662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37560ce-1087-46ca-92ab-7d90de5e2699 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:19.382712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37560ce-1087-46ca-92ab-7d90de5e2699 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:19.415402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6cf96-0f91-4da5-8c0f-40d6e84ef3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:19.416086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6cf96-0f91-4da5-8c0f-40d6e84ef3d0 None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:19.416375 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6cf96-0f91-4da5-8c0f-40d6e84ef3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:19.416652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6cf96-0f91-4da5-8c0f-40d6e84ef3d0 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:19.417351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6cf96-0f91-4da5-8c0f-40d6e84ef3d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:19.418778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6cf96-0f91-4da5-8c0f-40d6e84ef3d0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:19.437537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 575/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 22:00:19 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:00:21.464628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88050129-8c3e-464b-bedf-2250a0eb482e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:21.465150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88050129-8c3e-464b-bedf-2250a0eb482e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:21.465150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88050129-8c3e-464b-bedf-2250a0eb482e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:21.466472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 564/1139] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:21.472570 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e49fe-9d87-4326-a577-e6ac3f11780a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:21.473005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e49fe-9d87-4326-a577-e6ac3f11780a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:21.473117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e49fe-9d87-4326-a577-e6ac3f11780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:21.478073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:21.492120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f76e49fe-9d87-4326-a577-e6ac3f11780a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:21.493316 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f76e49fe-9d87-4326-a577-e6ac3f11780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:21.556831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 576/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:21.580771 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88050129-8c3e-464b-bedf-2250a0eb482e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:21.626582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:21.678605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88050129-8c3e-464b-bedf-2250a0eb482e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:21.710812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84523db-e811-4db3-bea9-4c2a4cd28abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:21.711585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84523db-e811-4db3-bea9-4c2a4cd28abf None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:21.711866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84523db-e811-4db3-bea9-4c2a4cd28abf None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:21.712172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84523db-e811-4db3-bea9-4c2a4cd28abf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:21.722519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84523db-e811-4db3-bea9-4c2a4cd28abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-d84523db-e811-4db3-bea9-4c2a4cd28abf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:00:21.729999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:21.731145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:21.732619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 565/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:00:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:21.737114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e49fe-9d87-4326-a577-e6ac3f11780a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:21.831605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e49fe-9d87-4326-a577-e6ac3f11780a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:21.860032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:21.865238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2201d-4bdf-4841-b587-27da714f9ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:21.865892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2201d-4bdf-4841-b587-27da714f9ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:21.866175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2201d-4bdf-4841-b587-27da714f9ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:21.866449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2201d-4bdf-4841-b587-27da714f9ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:21.867189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2201d-4bdf-4841-b587-27da714f9ad3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:21.867492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2201d-4bdf-4841-b587-27da714f9ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:21.868868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2201d-4bdf-4841-b587-27da714f9ad3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:21.876765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 577/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:21.882464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84523db-e811-4db3-bea9-4c2a4cd28abf None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:21.981616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84523db-e811-4db3-bea9-4c2a4cd28abf None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:21.988872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:22.014821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5bd4-5f39-434d-9a7c-52d8093ff73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:22.015681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5bd4-5f39-434d-9a7c-52d8093ff73e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:22.015997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5bd4-5f39-434d-9a7c-52d8093ff73e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:22.016279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5bd4-5f39-434d-9a7c-52d8093ff73e None admin] PATH_INFO: `/v3/users/2f3a57d1d28d4766b50269f54e7a6b29` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:22.029671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d5bd4-5f39-434d-9a7c-52d8093ff73e None admin] RBAC: Authorizing `identity:get_user(user_id=2f3a57d1d28d4766b50269f54e7a6b29)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:22.031098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d5bd4-5f39-434d-9a7c-52d8093ff73e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:22.032777 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 566/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:21 2022] GET /identity/v3/users/2f3a57d1d28d4766b50269f54e7a6b29 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:22.038477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2201d-4bdf-4841-b587-27da714f9ad3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:22.136011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2201d-4bdf-4841-b587-27da714f9ad3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:22.167801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef8d0c-b4c9-4678-b490-d6a1b02aac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:22.168467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef8d0c-b4c9-4678-b490-d6a1b02aac19 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:22.168748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef8d0c-b4c9-4678-b490-d6a1b02aac19 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:22.169020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef8d0c-b4c9-4678-b490-d6a1b02aac19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:22.227995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:22.236500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef8d0c-b4c9-4678-b490-d6a1b02aac19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:22.237885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef8d0c-b4c9-4678-b490-d6a1b02aac19 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:22.332291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 578/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:00:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:00:22.338115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5bd4-5f39-434d-9a7c-52d8093ff73e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:22.432220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5bd4-5f39-434d-9a7c-52d8093ff73e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:22.464732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad71bd-0557-4271-8138-8a0bb0d20ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:22.465573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad71bd-0557-4271-8138-8a0bb0d20ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:22.465851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad71bd-0557-4271-8138-8a0bb0d20ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:22.466122 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad71bd-0557-4271-8138-8a0bb0d20ac9 None admin] PATH_INFO: `/v3/projects/ed5a7d4c74e84ba8b0f479ddc7fc0cd6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:22.467385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad71bd-0557-4271-8138-8a0bb0d20ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5a7d4c74e84ba8b0f479ddc7fc0cd6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:22.468822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad71bd-0557-4271-8138-8a0bb0d20ac9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:22.470490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 567/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:22 2022] GET /identity/v3/projects/ed5a7d4c74e84ba8b0f479ddc7fc0cd6 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:22.476575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef8d0c-b4c9-4678-b490-d6a1b02aac19 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:22.566524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:22.573925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef8d0c-b4c9-4678-b490-d6a1b02aac19 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:22.607780 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8fc6c-56af-4681-9285-846e0de18e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:22.608442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8fc6c-56af-4681-9285-846e0de18e7d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:22.608727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8fc6c-56af-4681-9285-846e0de18e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:22.609001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8fc6c-56af-4681-9285-846e0de18e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:22.609820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8fc6c-56af-4681-9285-846e0de18e7d None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=ed5a7d4c74e84ba8b0f479ddc7fc0cd6, user.id=2f3a57d1d28d4766b50269f54e7a6b29) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:22.610128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8fc6c-56af-4681-9285-846e0de18e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:22.611536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8fc6c-56af-4681-9285-846e0de18e7d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:22.616763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 579/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:00:22 2022] GET /identity/v3/role_assignments?user.id=2f3a57d1d28d4766b50269f54e7a6b29&scope.project.id=ed5a7d4c74e84ba8b0f479ddc7fc0cd6&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:24.615772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797d2db-00d1-4996-a8f6-8c2d9cfecbd3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:24.616467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797d2db-00d1-4996-a8f6-8c2d9cfecbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:24.616467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797d2db-00d1-4996-a8f6-8c2d9cfecbd3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:24.617776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 568/1147] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:24.623178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e13e6-3c4a-47b0-b8e7-b6028c44eb2e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:24.623683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e13e6-3c4a-47b0-b8e7-b6028c44eb2e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:24.624110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e13e6-3c4a-47b0-b8e7-b6028c44eb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:24.640800 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2a1e13e6-3c4a-47b0-b8e7-b6028c44eb2e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:24.641973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2a1e13e6-3c4a-47b0-b8e7-b6028c44eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:24.706861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 580/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:24.729276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797d2db-00d1-4996-a8f6-8c2d9cfecbd3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:24.758885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:24.828454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797d2db-00d1-4996-a8f6-8c2d9cfecbd3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:24.864329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300ea6c-a748-4ab0-800e-83d3db0cad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:24.865120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300ea6c-a748-4ab0-800e-83d3db0cad45 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:24.865407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300ea6c-a748-4ab0-800e-83d3db0cad45 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:24.865687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300ea6c-a748-4ab0-800e-83d3db0cad45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:24.876412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300ea6c-a748-4ab0-800e-83d3db0cad45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8300ea6c-a748-4ab0-800e-83d3db0cad45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:00:24.883938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:24.885150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:24.886389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 569/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:00:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:24.891809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e13e6-3c4a-47b0-b8e7-b6028c44eb2e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:24.976157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:24.988078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e13e6-3c4a-47b0-b8e7-b6028c44eb2e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:25.021076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239cf1-cf7a-4afe-af60-9d914a4b4786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:25.021726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239cf1-cf7a-4afe-af60-9d914a4b4786 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:25.022010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239cf1-cf7a-4afe-af60-9d914a4b4786 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:25.022286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239cf1-cf7a-4afe-af60-9d914a4b4786 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:25.023026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93239cf1-cf7a-4afe-af60-9d914a4b4786 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:25.023332 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93239cf1-cf7a-4afe-af60-9d914a4b4786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:25.024705 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93239cf1-cf7a-4afe-af60-9d914a4b4786 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:25.032994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 581/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:25.038673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300ea6c-a748-4ab0-800e-83d3db0cad45 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:25.127674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:25.136675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300ea6c-a748-4ab0-800e-83d3db0cad45 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:25.172340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49538-aad3-4a40-88b6-738bfb63326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:25.173198 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49538-aad3-4a40-88b6-738bfb63326e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:25.173478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49538-aad3-4a40-88b6-738bfb63326e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:25.173751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49538-aad3-4a40-88b6-738bfb63326e None admin] PATH_INFO: `/v3/users/2f3a57d1d28d4766b50269f54e7a6b29` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:25.174932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c49538-aad3-4a40-88b6-738bfb63326e None admin] RBAC: Authorizing `identity:get_user(user_id=2f3a57d1d28d4766b50269f54e7a6b29)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:25.176376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c49538-aad3-4a40-88b6-738bfb63326e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:25.178024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 570/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:25 2022] GET /identity/v3/users/2f3a57d1d28d4766b50269f54e7a6b29 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:25.183872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239cf1-cf7a-4afe-af60-9d914a4b4786 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:25.280323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239cf1-cf7a-4afe-af60-9d914a4b4786 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:25.312621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73824023-180e-4f61-939f-ccb3ce9ab945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:25.313467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824023-180e-4f61-939f-ccb3ce9ab945 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:25.313754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824023-180e-4f61-939f-ccb3ce9ab945 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:25.314030 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824023-180e-4f61-939f-ccb3ce9ab945 None admin] PATH_INFO: `/v3/projects/ed5a7d4c74e84ba8b0f479ddc7fc0cd6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:25.315197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73824023-180e-4f61-939f-ccb3ce9ab945 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5a7d4c74e84ba8b0f479ddc7fc0cd6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:25.316642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73824023-180e-4f61-939f-ccb3ce9ab945 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:25.318303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 582/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:25 2022] GET /identity/v3/projects/ed5a7d4c74e84ba8b0f479ddc7fc0cd6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:25.324209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49538-aad3-4a40-88b6-738bfb63326e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:25.420723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49538-aad3-4a40-88b6-738bfb63326e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:25.453172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1a5e8-c97b-49fa-8591-b1954a75b870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:25.454047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a5e8-c97b-49fa-8591-b1954a75b870 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:25.454335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a5e8-c97b-49fa-8591-b1954a75b870 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:25.454862 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a5e8-c97b-49fa-8591-b1954a75b870 None admin] PATH_INFO: `/v3/projects/ed5a7d4c74e84ba8b0f479ddc7fc0cd6/users/2f3a57d1d28d4766b50269f54e7a6b29/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:25.456828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1a5e8-c97b-49fa-8591-b1954a75b870 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a7d4c74e84ba8b0f479ddc7fc0cd6, user_id=2f3a57d1d28d4766b50269f54e7a6b29, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:25.458249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1a5e8-c97b-49fa-8591-b1954a75b870 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:25.471595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 571/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 22:00:25 2022] PUT /identity/v3/projects/ed5a7d4c74e84ba8b0f479ddc7fc0cd6/users/2f3a57d1d28d4766b50269f54e7a6b29/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:00:27.470226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe5513-819f-4543-a98b-40740314b1ba None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:27.470746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe5513-819f-4543-a98b-40740314b1ba None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:27.470746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe5513-819f-4543-a98b-40740314b1ba None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:27.472112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 583/1154] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:27.477299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b31f-a506-4bf4-a8ba-61cafc7425fd None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:27.477697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b31f-a506-4bf4-a8ba-61cafc7425fd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:27.477867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b31f-a506-4bf4-a8ba-61cafc7425fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:27.494969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d905b31f-a506-4bf4-a8ba-61cafc7425fd None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:27.496187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d905b31f-a506-4bf4-a8ba-61cafc7425fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:27.509776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:27.561877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 572/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:27.585672 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe5513-819f-4543-a98b-40740314b1ba None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:27.605563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:27.687710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe5513-819f-4543-a98b-40740314b1ba None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:27.721399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3451833-8f85-4637-94ab-2eb04bb03903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:27.722119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3451833-8f85-4637-94ab-2eb04bb03903 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:27.722405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3451833-8f85-4637-94ab-2eb04bb03903 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:27.722680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3451833-8f85-4637-94ab-2eb04bb03903 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:27.733447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3451833-8f85-4637-94ab-2eb04bb03903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e3451833-8f85-4637-94ab-2eb04bb03903 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:00:27.741152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:27.742246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:00:27.743133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 584/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:00:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:27.748952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905b31f-a506-4bf4-a8ba-61cafc7425fd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:27.846342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905b31f-a506-4bf4-a8ba-61cafc7425fd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:27.878248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d215c87-9c47-4a77-a2a2-44469b7470e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:27.878931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d215c87-9c47-4a77-a2a2-44469b7470e4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:27.879221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d215c87-9c47-4a77-a2a2-44469b7470e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:27.879500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d215c87-9c47-4a77-a2a2-44469b7470e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:27.880345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d215c87-9c47-4a77-a2a2-44469b7470e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:27.880657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d215c87-9c47-4a77-a2a2-44469b7470e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:27.882004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d215c87-9c47-4a77-a2a2-44469b7470e4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:27.890386 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 573/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:00:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:27.896116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3451833-8f85-4637-94ab-2eb04bb03903 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:27.974214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:27.995241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3451833-8f85-4637-94ab-2eb04bb03903 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:28.029531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38770496-5b8b-4875-b709-106069b90d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:28.030400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38770496-5b8b-4875-b709-106069b90d3f None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:28.030692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38770496-5b8b-4875-b709-106069b90d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:28.030974 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38770496-5b8b-4875-b709-106069b90d3f None admin] PATH_INFO: `/v3/users/2f3a57d1d28d4766b50269f54e7a6b29` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:28.032194 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38770496-5b8b-4875-b709-106069b90d3f None admin] RBAC: Authorizing `identity:get_user(user_id=2f3a57d1d28d4766b50269f54e7a6b29)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:28.033642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38770496-5b8b-4875-b709-106069b90d3f None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:28.035277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 585/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:27 2022] GET /identity/v3/users/2f3a57d1d28d4766b50269f54e7a6b29 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:28.040958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d215c87-9c47-4a77-a2a2-44469b7470e4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:28.055823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:28.138969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d215c87-9c47-4a77-a2a2-44469b7470e4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:28.171637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018950-9f3f-46bc-af4e-e7f5eca5e520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:28.172318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018950-9f3f-46bc-af4e-e7f5eca5e520 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:28.172606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018950-9f3f-46bc-af4e-e7f5eca5e520 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:28.172886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018950-9f3f-46bc-af4e-e7f5eca5e520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:28.237580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d018950-9f3f-46bc-af4e-e7f5eca5e520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:28.239022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d018950-9f3f-46bc-af4e-e7f5eca5e520 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:28.251707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:28.342567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 574/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:00:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:00:28.348404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38770496-5b8b-4875-b709-106069b90d3f None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:28.443874 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38770496-5b8b-4875-b709-106069b90d3f None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:28.475624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bc949-f630-4e9b-8243-b2a82e6cd875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:28.476503 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bc949-f630-4e9b-8243-b2a82e6cd875 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:28.476787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bc949-f630-4e9b-8243-b2a82e6cd875 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:28.477065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bc949-f630-4e9b-8243-b2a82e6cd875 None admin] PATH_INFO: `/v3/projects/ed5a7d4c74e84ba8b0f479ddc7fc0cd6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:28.478228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bc949-f630-4e9b-8243-b2a82e6cd875 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5a7d4c74e84ba8b0f479ddc7fc0cd6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:28.479649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bc949-f630-4e9b-8243-b2a82e6cd875 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:28.481330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 586/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:28 2022] GET /identity/v3/projects/ed5a7d4c74e84ba8b0f479ddc7fc0cd6 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:28.487783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018950-9f3f-46bc-af4e-e7f5eca5e520 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:28.584817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018950-9f3f-46bc-af4e-e7f5eca5e520 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:28.597529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:28.618726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7482ba8-edd7-4942-8106-d5e8ef8466de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:28.619379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7482ba8-edd7-4942-8106-d5e8ef8466de None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:28.619669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7482ba8-edd7-4942-8106-d5e8ef8466de None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:28.619976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7482ba8-edd7-4942-8106-d5e8ef8466de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:28.620806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7482ba8-edd7-4942-8106-d5e8ef8466de None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=ed5a7d4c74e84ba8b0f479ddc7fc0cd6, user.id=2f3a57d1d28d4766b50269f54e7a6b29) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:28.621121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7482ba8-edd7-4942-8106-d5e8ef8466de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:28.623094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7482ba8-edd7-4942-8106-d5e8ef8466de None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:28.628803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 575/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:00:28 2022] GET /identity/v3/role_assignments?user.id=2f3a57d1d28d4766b50269f54e7a6b29&scope.project.id=ed5a7d4c74e84ba8b0f479ddc7fc0cd6&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:30.666704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449250c-7438-48fe-8501-2f5eb68b02ad None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:30.667232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449250c-7438-48fe-8501-2f5eb68b02ad None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:30.667325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449250c-7438-48fe-8501-2f5eb68b02ad None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:30.668671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 587/1162] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:30.674251 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d9759-ae18-4bfe-91e4-c0933f66e849 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:30.674625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d9759-ae18-4bfe-91e4-c0933f66e849 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:30.674819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d9759-ae18-4bfe-91e4-c0933f66e849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:30.691975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b83d9759-ae18-4bfe-91e4-c0933f66e849 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:30.693160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b83d9759-ae18-4bfe-91e4-c0933f66e849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:30.757266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 576/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 22:00:30.779200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449250c-7438-48fe-8501-2f5eb68b02ad None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:30.795283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:30.879772 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449250c-7438-48fe-8501-2f5eb68b02ad None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:30.911979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb74be-4425-4541-9b73-c34c8ea3dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:30.912609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb74be-4425-4541-9b73-c34c8ea3dd08 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:30.912900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb74be-4425-4541-9b73-c34c8ea3dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:30.913181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb74be-4425-4541-9b73-c34c8ea3dd08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:30.977686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb74be-4425-4541-9b73-c34c8ea3dd08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:30.979057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb74be-4425-4541-9b73-c34c8ea3dd08 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:30.992862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:31.074227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 588/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:00:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:00:31.081003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d9759-ae18-4bfe-91e4-c0933f66e849 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:31.175297 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d9759-ae18-4bfe-91e4-c0933f66e849 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:31.182362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:31.209363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a63b7-f5cf-4d9c-a72b-b81a5adcfb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:31.210155 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a63b7-f5cf-4d9c-a72b-b81a5adcfb95 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:31.210440 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a63b7-f5cf-4d9c-a72b-b81a5adcfb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:31.210719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a63b7-f5cf-4d9c-a72b-b81a5adcfb95 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:31.217767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a63b7-f5cf-4d9c-a72b-b81a5adcfb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:31.219227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a63b7-f5cf-4d9c-a72b-b81a5adcfb95 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-664a63b7-f5cf-4d9c-a72b-b81a5adcfb95 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:31.233806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:31.235023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:31.236236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 577/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 22:00:31 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:31.240910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb74be-4425-4541-9b73-c34c8ea3dd08 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:31.336253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb74be-4425-4541-9b73-c34c8ea3dd08 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:31.349983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:31.369875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0661f-3a6b-45f8-a371-2dc9d05899ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:31.370528 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0661f-3a6b-45f8-a371-2dc9d05899ea None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:31.370814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0661f-3a6b-45f8-a371-2dc9d05899ea None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:31.371093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0661f-3a6b-45f8-a371-2dc9d05899ea None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:31.371809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0661f-3a6b-45f8-a371-2dc9d05899ea None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:31.372180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0661f-3a6b-45f8-a371-2dc9d05899ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:31.373714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0661f-3a6b-45f8-a371-2dc9d05899ea None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:31.380649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 589/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 22:00:31 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:33.379741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619543b-4060-4fd0-98e3-0ced2f13aa8c None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:33.380287 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619543b-4060-4fd0-98e3-0ced2f13aa8c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:33.380287 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619543b-4060-4fd0-98e3-0ced2f13aa8c None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:33.381615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 578/1167] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:33.386646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca7d4-3e63-40d9-b186-e2af4216febb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:33.387076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca7d4-3e63-40d9-b186-e2af4216febb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:33.387201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca7d4-3e63-40d9-b186-e2af4216febb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:33.404376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5e7ca7d4-3e63-40d9-b186-e2af4216febb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:33.405556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5e7ca7d4-3e63-40d9-b186-e2af4216febb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:33.470136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 590/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:33.493637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619543b-4060-4fd0-98e3-0ced2f13aa8c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:33.591414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619543b-4060-4fd0-98e3-0ced2f13aa8c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:33.623475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a4a98-a0e7-4d83-9d0e-962d552cae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:33.624141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a4a98-a0e7-4d83-9d0e-962d552cae98 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:33.624427 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a4a98-a0e7-4d83-9d0e-962d552cae98 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:33.624706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a4a98-a0e7-4d83-9d0e-962d552cae98 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:33.625429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a4a98-a0e7-4d83-9d0e-962d552cae98 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:33.626769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a4a98-a0e7-4d83-9d0e-962d552cae98 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:33.641964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 579/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Wed Jul 13 22:00:33 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:00:35.678277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf1d3e-941b-476c-b756-d609ab0ce8e2 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:35.678839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf1d3e-941b-476c-b756-d609ab0ce8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:35.678839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf1d3e-941b-476c-b756-d609ab0ce8e2 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:35.680246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 591/1170] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:35.686424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19699a5-3e6a-475b-b109-8e44b64cbc09 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:35.686849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19699a5-3e6a-475b-b109-8e44b64cbc09 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:35.686978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19699a5-3e6a-475b-b109-8e44b64cbc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:35.704781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f19699a5-3e6a-475b-b109-8e44b64cbc09 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:35.706060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f19699a5-3e6a-475b-b109-8e44b64cbc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:35.725413 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:35.773150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 580/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:35.796388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf1d3e-941b-476c-b756-d609ab0ce8e2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:35.897983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf1d3e-941b-476c-b756-d609ab0ce8e2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:35.907256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:35.932092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb962b-8304-4ff1-8d4d-5234b7341ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:35.932881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb962b-8304-4ff1-8d4d-5234b7341ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:35.933165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb962b-8304-4ff1-8d4d-5234b7341ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:35.933444 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb962b-8304-4ff1-8d4d-5234b7341ab5 None admin] PATH_INFO: `/v3/domains/8153a2475bc848598b26b8dba30140e4` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:35.944468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb962b-8304-4ff1-8d4d-5234b7341ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8153a2475bc848598b26b8dba30140e4)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:35.945922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb962b-8304-4ff1-8d4d-5234b7341ab5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:35.947545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 592/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Jul 13 22:00:35 2022] GET /identity/v3/domains/8153a2475bc848598b26b8dba30140e4 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:35.953902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19699a5-3e6a-475b-b109-8e44b64cbc09 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:36.048299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19699a5-3e6a-475b-b109-8e44b64cbc09 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:36.080547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac1f14-1594-451d-aaed-e590ec4b29e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:36.081193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac1f14-1594-451d-aaed-e590ec4b29e8 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:36.081476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac1f14-1594-451d-aaed-e590ec4b29e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:36.081750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac1f14-1594-451d-aaed-e590ec4b29e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:36.082444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac1f14-1594-451d-aaed-e590ec4b29e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:36.083856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac1f14-1594-451d-aaed-e590ec4b29e8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:36.110695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 581/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 22:00:35 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:00:38.165228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09535198-153e-4b48-96bd-a48b12807060 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:38.165742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09535198-153e-4b48-96bd-a48b12807060 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:38.165829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09535198-153e-4b48-96bd-a48b12807060 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:38.167154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 593/1174] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:38.174179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbc9a5-beef-4f5a-9223-477864d582e6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:38.174622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbc9a5-beef-4f5a-9223-477864d582e6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:38.174748 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbc9a5-beef-4f5a-9223-477864d582e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:38.191705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0cdbc9a5-beef-4f5a-9223-477864d582e6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:38.192921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0cdbc9a5-beef-4f5a-9223-477864d582e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:38.194830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:38.259279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 582/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:38.284851 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09535198-153e-4b48-96bd-a48b12807060 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:38.384841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09535198-153e-4b48-96bd-a48b12807060 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:38.417883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea265b-aff6-470f-b2bd-4649fcedbf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:38.418960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea265b-aff6-470f-b2bd-4649fcedbf29 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:38.419258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea265b-aff6-470f-b2bd-4649fcedbf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:38.419538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea265b-aff6-470f-b2bd-4649fcedbf29 None admin] PATH_INFO: `/v3/domains/8153a2475bc848598b26b8dba30140e4` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:38.420743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea265b-aff6-470f-b2bd-4649fcedbf29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8153a2475bc848598b26b8dba30140e4)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:38.422163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea265b-aff6-470f-b2bd-4649fcedbf29 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:38.423759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 594/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Jul 13 22:00:38 2022] GET /identity/v3/domains/8153a2475bc848598b26b8dba30140e4 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:38.429475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbc9a5-beef-4f5a-9223-477864d582e6 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:38.523563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbc9a5-beef-4f5a-9223-477864d582e6 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:38.556020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaadcfa-0c74-4945-a15e-98b1e513e909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:38.556673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaadcfa-0c74-4945-a15e-98b1e513e909 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:38.556957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaadcfa-0c74-4945-a15e-98b1e513e909 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:38.557235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaadcfa-0c74-4945-a15e-98b1e513e909 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:38.557939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaadcfa-0c74-4945-a15e-98b1e513e909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:38.559868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaadcfa-0c74-4945-a15e-98b1e513e909 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:38.568159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:38.580304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 583/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 22:00:38 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:00:40.696434 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bd69a-be60-4760-8e6d-f9deda83f129 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:40.696956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bd69a-be60-4760-8e6d-f9deda83f129 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:40.697074 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bd69a-be60-4760-8e6d-f9deda83f129 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:40.698378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 595/1178] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:40.703564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db04c2-4ad6-485b-8fa5-3c3f8067a1e2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:40.704264 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db04c2-4ad6-485b-8fa5-3c3f8067a1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:40.704406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db04c2-4ad6-485b-8fa5-3c3f8067a1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:40.721190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-36db04c2-4ad6-485b-8fa5-3c3f8067a1e2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:40.722361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-36db04c2-4ad6-485b-8fa5-3c3f8067a1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:40.785694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 584/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:40.809317 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bd69a-be60-4760-8e6d-f9deda83f129 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:40.844416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:40.907360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bd69a-be60-4760-8e6d-f9deda83f129 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:40.939858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435edcd-6ff1-4bcc-950b-7517bc4d1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:40.940669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435edcd-6ff1-4bcc-950b-7517bc4d1a93 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:40.940957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435edcd-6ff1-4bcc-950b-7517bc4d1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:40.941238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435edcd-6ff1-4bcc-950b-7517bc4d1a93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:40.951268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435edcd-6ff1-4bcc-950b-7517bc4d1a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e435edcd-6ff1-4bcc-950b-7517bc4d1a93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:00:40.959112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:40.960296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:00:40.961599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 596/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:40.966766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db04c2-4ad6-485b-8fa5-3c3f8067a1e2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:41.062461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db04c2-4ad6-485b-8fa5-3c3f8067a1e2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:41.085477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:41.097101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7920d76-9472-4f90-a7f9-a59d992c9576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:41.097771 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7920d76-9472-4f90-a7f9-a59d992c9576 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:41.098061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7920d76-9472-4f90-a7f9-a59d992c9576 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:41.098345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7920d76-9472-4f90-a7f9-a59d992c9576 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:41.099097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7920d76-9472-4f90-a7f9-a59d992c9576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:41.099410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7920d76-9472-4f90-a7f9-a59d992c9576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:41.100842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7920d76-9472-4f90-a7f9-a59d992c9576 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:41.109884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 585/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:00:41.115730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435edcd-6ff1-4bcc-950b-7517bc4d1a93 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:41.207452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:41.213462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435edcd-6ff1-4bcc-950b-7517bc4d1a93 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:41.245756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c78093-72b2-4a9d-ab88-a2a92cff3b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:41.246643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78093-72b2-4a9d-ab88-a2a92cff3b61 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:41.247055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78093-72b2-4a9d-ab88-a2a92cff3b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:41.247334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78093-72b2-4a9d-ab88-a2a92cff3b61 None admin] PATH_INFO: `/v3/users/67e9d95667df4e4bb2bb2bc356d4700c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:41.259728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c78093-72b2-4a9d-ab88-a2a92cff3b61 None admin] RBAC: Authorizing `identity:get_user(user_id=67e9d95667df4e4bb2bb2bc356d4700c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:41.261181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c78093-72b2-4a9d-ab88-a2a92cff3b61 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:41.263478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 597/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:41 2022] GET /identity/v3/users/67e9d95667df4e4bb2bb2bc356d4700c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:41.269279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7920d76-9472-4f90-a7f9-a59d992c9576 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:41.365447 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7920d76-9472-4f90-a7f9-a59d992c9576 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:41.397178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0af550-e620-4fc1-bfef-025c01309fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:41.397819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0af550-e620-4fc1-bfef-025c01309fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:41.398105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0af550-e620-4fc1-bfef-025c01309fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:41.398386 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0af550-e620-4fc1-bfef-025c01309fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:41.449904 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:41.462705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0af550-e620-4fc1-bfef-025c01309fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:41.464112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0af550-e620-4fc1-bfef-025c01309fd1 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:41.558214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 586/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:00:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:00:41.565376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c78093-72b2-4a9d-ab88-a2a92cff3b61 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:41.667575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c78093-72b2-4a9d-ab88-a2a92cff3b61 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:41.706085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d19d43-2c7a-4bf6-a366-b482af7cf033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:41.706949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d19d43-2c7a-4bf6-a366-b482af7cf033 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:41.707236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d19d43-2c7a-4bf6-a366-b482af7cf033 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:41.707514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d19d43-2c7a-4bf6-a366-b482af7cf033 None admin] PATH_INFO: `/v3/projects/f4ddb35db9484168afac3158c0ec884d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:41.708719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d19d43-2c7a-4bf6-a366-b482af7cf033 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ddb35db9484168afac3158c0ec884d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:41.710147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d19d43-2c7a-4bf6-a366-b482af7cf033 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:41.711848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 598/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:41 2022] GET /identity/v3/projects/f4ddb35db9484168afac3158c0ec884d => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:41.718516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0af550-e620-4fc1-bfef-025c01309fd1 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:41.799918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:41.814625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0af550-e620-4fc1-bfef-025c01309fd1 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:41.847463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccfe35-dc5c-4904-8b77-581aad5b3751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:41.848125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccfe35-dc5c-4904-8b77-581aad5b3751 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:41.848411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccfe35-dc5c-4904-8b77-581aad5b3751 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:41.848690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccfe35-dc5c-4904-8b77-581aad5b3751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:41.849508 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccfe35-dc5c-4904-8b77-581aad5b3751 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=f4ddb35db9484168afac3158c0ec884d, user.id=67e9d95667df4e4bb2bb2bc356d4700c) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:41.849817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccfe35-dc5c-4904-8b77-581aad5b3751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:41.851215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccfe35-dc5c-4904-8b77-581aad5b3751 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:41.856476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 587/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:00:41 2022] GET /identity/v3/role_assignments?user.id=67e9d95667df4e4bb2bb2bc356d4700c&scope.project.id=f4ddb35db9484168afac3158c0ec884d&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:43.877936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf14be-9503-4137-9ff0-5f305cc5675e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:43.878515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf14be-9503-4137-9ff0-5f305cc5675e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:43.878832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf14be-9503-4137-9ff0-5f305cc5675e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:43.881096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 599/1186] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:43.886930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77055256-d98c-42b0-aaf6-10b4aad0afe8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:43.887956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77055256-d98c-42b0-aaf6-10b4aad0afe8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:43.888417 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77055256-d98c-42b0-aaf6-10b4aad0afe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:43.905698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-77055256-d98c-42b0-aaf6-10b4aad0afe8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:43.906895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-77055256-d98c-42b0-aaf6-10b4aad0afe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:43.984517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 588/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:44.008465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf14be-9503-4137-9ff0-5f305cc5675e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:44.035236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:44.119791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf14be-9503-4137-9ff0-5f305cc5675e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:44.162502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee6c97-b703-45f0-aa1a-27d0c8afcbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:44.165545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee6c97-b703-45f0-aa1a-27d0c8afcbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:44.165824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee6c97-b703-45f0-aa1a-27d0c8afcbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:44.166095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee6c97-b703-45f0-aa1a-27d0c8afcbf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:44.177917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee6c97-b703-45f0-aa1a-27d0c8afcbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c2ee6c97-b703-45f0-aa1a-27d0c8afcbf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:00:44.186408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:44.187396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:00:44.188284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 600/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:00:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:44.193830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77055256-d98c-42b0-aaf6-10b4aad0afe8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:44.281398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:44.302591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77055256-d98c-42b0-aaf6-10b4aad0afe8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:44.337839 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babed561-0857-43c4-af5a-c128d5bd0ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:44.338551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed561-0857-43c4-af5a-c128d5bd0ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:44.338792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed561-0857-43c4-af5a-c128d5bd0ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:44.339075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed561-0857-43c4-af5a-c128d5bd0ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:44.339827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babed561-0857-43c4-af5a-c128d5bd0ac4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:44.340187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babed561-0857-43c4-af5a-c128d5bd0ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:44.341706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babed561-0857-43c4-af5a-c128d5bd0ac4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:44.350011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 589/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:00:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:44.357534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee6c97-b703-45f0-aa1a-27d0c8afcbf1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:44.444238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:44.463835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee6c97-b703-45f0-aa1a-27d0c8afcbf1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:44.504401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f1181-f920-41fe-a87d-a07f4f495a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:44.505886 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f1181-f920-41fe-a87d-a07f4f495a64 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:44.506362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f1181-f920-41fe-a87d-a07f4f495a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:44.506831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f1181-f920-41fe-a87d-a07f4f495a64 None admin] PATH_INFO: `/v3/users/67e9d95667df4e4bb2bb2bc356d4700c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:44.508835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f1181-f920-41fe-a87d-a07f4f495a64 None admin] RBAC: Authorizing `identity:get_user(user_id=67e9d95667df4e4bb2bb2bc356d4700c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:44.511383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f1181-f920-41fe-a87d-a07f4f495a64 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:44.513905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 601/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:44 2022] GET /identity/v3/users/67e9d95667df4e4bb2bb2bc356d4700c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:44.519741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babed561-0857-43c4-af5a-c128d5bd0ac4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:44.615881 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babed561-0857-43c4-af5a-c128d5bd0ac4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:44.648027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2ed4-c28c-4fab-a279-726d8c91a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:44.648873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2ed4-c28c-4fab-a279-726d8c91a037 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:44.649155 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2ed4-c28c-4fab-a279-726d8c91a037 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:44.649431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2ed4-c28c-4fab-a279-726d8c91a037 None admin] PATH_INFO: `/v3/projects/f4ddb35db9484168afac3158c0ec884d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:44.650586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2ed4-c28c-4fab-a279-726d8c91a037 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ddb35db9484168afac3158c0ec884d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:44.652026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2ed4-c28c-4fab-a279-726d8c91a037 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:44.654525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 590/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:44 2022] GET /identity/v3/projects/f4ddb35db9484168afac3158c0ec884d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:44.660580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f1181-f920-41fe-a87d-a07f4f495a64 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:44.758400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f1181-f920-41fe-a87d-a07f4f495a64 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:44.790524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234f2e5-7b6a-4f1c-969c-046e8dc18586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:44.791406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234f2e5-7b6a-4f1c-969c-046e8dc18586 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:44.791686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234f2e5-7b6a-4f1c-969c-046e8dc18586 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:44.791986 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234f2e5-7b6a-4f1c-969c-046e8dc18586 None admin] PATH_INFO: `/v3/projects/f4ddb35db9484168afac3158c0ec884d/users/67e9d95667df4e4bb2bb2bc356d4700c/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:44.794042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234f2e5-7b6a-4f1c-969c-046e8dc18586 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4ddb35db9484168afac3158c0ec884d, user_id=67e9d95667df4e4bb2bb2bc356d4700c, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:44.795458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234f2e5-7b6a-4f1c-969c-046e8dc18586 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:44.807970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 602/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 22:00:44 2022] PUT /identity/v3/projects/f4ddb35db9484168afac3158c0ec884d/users/67e9d95667df4e4bb2bb2bc356d4700c/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:00:46.803816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b63ff-2547-4fd1-a4ca-a84f129caedd None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:46.804380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b63ff-2547-4fd1-a4ca-a84f129caedd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:46.804488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b63ff-2547-4fd1-a4ca-a84f129caedd None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:46.805786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 591/1193] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:00:46.811296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37efe2a-6e82-4833-b5b1-abee4ace6003 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:46.811742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37efe2a-6e82-4833-b5b1-abee4ace6003 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:46.811842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37efe2a-6e82-4833-b5b1-abee4ace6003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:46.828486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f37efe2a-6e82-4833-b5b1-abee4ace6003 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:00:46.829910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f37efe2a-6e82-4833-b5b1-abee4ace6003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:00:46.832586 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:46.894690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 603/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:00:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:00:46.917997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b63ff-2547-4fd1-a4ca-a84f129caedd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:46.930210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:47.017577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b63ff-2547-4fd1-a4ca-a84f129caedd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:47.050215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a6942-40d1-4c8e-87ed-b5608e453120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:47.050988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a6942-40d1-4c8e-87ed-b5608e453120 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:47.051270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a6942-40d1-4c8e-87ed-b5608e453120 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:47.051547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a6942-40d1-4c8e-87ed-b5608e453120 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:47.061610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a6942-40d1-4c8e-87ed-b5608e453120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-c85a6942-40d1-4c8e-87ed-b5608e453120 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:00:47.069094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:00:47.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:00:47.071166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 592/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:00:47.076728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37efe2a-6e82-4833-b5b1-abee4ace6003 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:47.172001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37efe2a-6e82-4833-b5b1-abee4ace6003 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:47.204911 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81bf7f-167d-4261-b660-bef50bef2cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:47.205569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81bf7f-167d-4261-b660-bef50bef2cdb None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:47.205855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81bf7f-167d-4261-b660-bef50bef2cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:47.206129 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81bf7f-167d-4261-b660-bef50bef2cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:47.206901 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81bf7f-167d-4261-b660-bef50bef2cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:47.207207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81bf7f-167d-4261-b660-bef50bef2cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:47.208580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81bf7f-167d-4261-b660-bef50bef2cdb None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:47.217006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 604/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:00:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:47.222675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a6942-40d1-4c8e-87ed-b5608e453120 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:47.288764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:47.321057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a6942-40d1-4c8e-87ed-b5608e453120 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:47.352762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cdc42-7a02-4f79-a998-f46ed9dc0918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:47.353622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdc42-7a02-4f79-a998-f46ed9dc0918 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:47.353902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdc42-7a02-4f79-a998-f46ed9dc0918 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:47.354172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdc42-7a02-4f79-a998-f46ed9dc0918 None admin] PATH_INFO: `/v3/users/67e9d95667df4e4bb2bb2bc356d4700c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:47.355348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cdc42-7a02-4f79-a998-f46ed9dc0918 None admin] RBAC: Authorizing `identity:get_user(user_id=67e9d95667df4e4bb2bb2bc356d4700c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:47.357327 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cdc42-7a02-4f79-a998-f46ed9dc0918 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:47.358938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 593/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 22:00:47 2022] GET /identity/v3/users/67e9d95667df4e4bb2bb2bc356d4700c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:47.364674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81bf7f-167d-4261-b660-bef50bef2cdb None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:47.367466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:47.462021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81bf7f-167d-4261-b660-bef50bef2cdb None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:47.494496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc007ff8-8bae-46e8-8ba2-75ea297fe8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:47.495138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc007ff8-8bae-46e8-8ba2-75ea297fe8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:47.495424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc007ff8-8bae-46e8-8ba2-75ea297fe8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:47.495703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc007ff8-8bae-46e8-8ba2-75ea297fe8c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:47.560336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc007ff8-8bae-46e8-8ba2-75ea297fe8c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:47.561782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc007ff8-8bae-46e8-8ba2-75ea297fe8c5 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:47.563506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:47.656693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 605/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:00:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:00:47.662645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cdc42-7a02-4f79-a998-f46ed9dc0918 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:47.757910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cdc42-7a02-4f79-a998-f46ed9dc0918 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:47.790224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca56cbd-fa25-469c-8b79-05ce16bed8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:47.791078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca56cbd-fa25-469c-8b79-05ce16bed8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:47.791366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca56cbd-fa25-469c-8b79-05ce16bed8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:47.791645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca56cbd-fa25-469c-8b79-05ce16bed8a7 None admin] PATH_INFO: `/v3/projects/f4ddb35db9484168afac3158c0ec884d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:47.793426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca56cbd-fa25-469c-8b79-05ce16bed8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ddb35db9484168afac3158c0ec884d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:47.794857 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca56cbd-fa25-469c-8b79-05ce16bed8a7 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:47.796722 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 594/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 22:00:47 2022] GET /identity/v3/projects/f4ddb35db9484168afac3158c0ec884d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:47.802643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc007ff8-8bae-46e8-8ba2-75ea297fe8c5 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:00:47.898603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc007ff8-8bae-46e8-8ba2-75ea297fe8c5 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:00:47.900098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:47.936928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883732d-5471-43e2-b55b-68c5213a34ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:00:47.937497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883732d-5471-43e2-b55b-68c5213a34ba None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:00:47.937781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883732d-5471-43e2-b55b-68c5213a34ba None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:00:47.938056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883732d-5471-43e2-b55b-68c5213a34ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:00:47.938877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883732d-5471-43e2-b55b-68c5213a34ba None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=f4ddb35db9484168afac3158c0ec884d, user.id=67e9d95667df4e4bb2bb2bc356d4700c) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:00:47.939189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883732d-5471-43e2-b55b-68c5213a34ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:00:47.940635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883732d-5471-43e2-b55b-68c5213a34ba None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:00:47.946297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 606/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:00:47 2022] GET /identity/v3/role_assignments?user.id=67e9d95667df4e4bb2bb2bc356d4700c&scope.project.id=f4ddb35db9484168afac3158c0ec884d&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:00:57.786526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:00:57.943704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=17 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:43.524692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9385-e83c-44d9-a204-a9af44c7e4ac None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:43.525400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9385-e83c-44d9-a204-a9af44c7e4ac None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:43.525400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9385-e83c-44d9-a204-a9af44c7e4ac None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:43.526610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 595/1201] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:01:43.532064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a4e1-80e1-4644-bd3f-cfa86a2490b1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:43.532544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a4e1-80e1-4644-bd3f-cfa86a2490b1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:43.532631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a4e1-80e1-4644-bd3f-cfa86a2490b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:43.551102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b576a4e1-80e1-4644-bd3f-cfa86a2490b1 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:01:43.553154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b576a4e1-80e1-4644-bd3f-cfa86a2490b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:01:43.629064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 607/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:01:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:01:43.654690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9385-e83c-44d9-a204-a9af44c7e4ac None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:43.795797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9385-e83c-44d9-a204-a9af44c7e4ac None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:43.843260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f70eb3-97ef-4cb0-87dc-5b942871935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:43.844825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70eb3-97ef-4cb0-87dc-5b942871935d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:43.845332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70eb3-97ef-4cb0-87dc-5b942871935d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:43.845679 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70eb3-97ef-4cb0-87dc-5b942871935d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:43.860150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f70eb3-97ef-4cb0-87dc-5b942871935d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:43.865414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f70eb3-97ef-4cb0-87dc-5b942871935d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-e4f70eb3-97ef-4cb0-87dc-5b942871935d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:01:43.890303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:43.892248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:43.893312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:01:43.893312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:01:43.893312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:43.893312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:01:43.893312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 596/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:43.901546 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576a4e1-80e1-4644-bd3f-cfa86a2490b1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:44.058459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576a4e1-80e1-4644-bd3f-cfa86a2490b1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:44.099303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:44.105142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb654192-5bdf-4a9a-9b57-ff2729b5b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:44.105927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb654192-5bdf-4a9a-9b57-ff2729b5b509 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:44.106345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb654192-5bdf-4a9a-9b57-ff2729b5b509 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:44.107097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb654192-5bdf-4a9a-9b57-ff2729b5b509 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:44.108069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb654192-5bdf-4a9a-9b57-ff2729b5b509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:44.108372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb654192-5bdf-4a9a-9b57-ff2729b5b509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:44.110709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb654192-5bdf-4a9a-9b57-ff2729b5b509 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:44.132003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 608/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:44.136560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f70eb3-97ef-4cb0-87dc-5b942871935d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:44.212656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:44.278499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f70eb3-97ef-4cb0-87dc-5b942871935d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:44.320261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15637aed-52ce-4862-88c9-2632fcca1ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:44.320939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15637aed-52ce-4862-88c9-2632fcca1ad4 None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:44.321282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15637aed-52ce-4862-88c9-2632fcca1ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:44.321859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15637aed-52ce-4862-88c9-2632fcca1ad4 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:44.323025 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15637aed-52ce-4862-88c9-2632fcca1ad4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:44.325827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15637aed-52ce-4862-88c9-2632fcca1ad4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:44.360190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 597/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 22:01:44 2022] POST /identity/v3/users => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:01:46.588949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06979e0-61f1-493f-8d08-620a6176051c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:46.589523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06979e0-61f1-493f-8d08-620a6176051c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:46.589523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06979e0-61f1-493f-8d08-620a6176051c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:46.591771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 609/1206] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:01:46.598486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb6b8c-cbad-4f1b-bcdf-3cb26d8f141b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:46.598962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb6b8c-cbad-4f1b-bcdf-3cb26d8f141b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:46.599124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb6b8c-cbad-4f1b-bcdf-3cb26d8f141b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:46.616986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bfbb6b8c-cbad-4f1b-bcdf-3cb26d8f141b None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:01:46.618294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bfbb6b8c-cbad-4f1b-bcdf-3cb26d8f141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:01:46.692354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 598/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:01:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:01:46.717256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06979e0-61f1-493f-8d08-620a6176051c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:46.845609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06979e0-61f1-493f-8d08-620a6176051c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:46.886090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77890a-f063-4190-8675-ddfe363bb1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:46.886857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77890a-f063-4190-8675-ddfe363bb1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:46.887140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77890a-f063-4190-8675-ddfe363bb1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:46.887677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77890a-f063-4190-8675-ddfe363bb1a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:46.900908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77890a-f063-4190-8675-ddfe363bb1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4a77890a-f063-4190-8675-ddfe363bb1a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:01:46.908946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:46.910247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:46.911112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 610/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 22:01:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:46.916361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb6b8c-cbad-4f1b-bcdf-3cb26d8f141b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:46.960833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:47.026517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb6b8c-cbad-4f1b-bcdf-3cb26d8f141b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:47.069419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e72c1-1404-4553-8b07-0a1fe323527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:47.070133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e72c1-1404-4553-8b07-0a1fe323527d None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:47.070458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e72c1-1404-4553-8b07-0a1fe323527d None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:47.070762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e72c1-1404-4553-8b07-0a1fe323527d None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:47.071525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e72c1-1404-4553-8b07-0a1fe323527d None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:47.071824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e72c1-1404-4553-8b07-0a1fe323527d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:47.073318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e72c1-1404-4553-8b07-0a1fe323527d None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:47.087587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 599/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 22:01:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:47.088966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77890a-f063-4190-8675-ddfe363bb1a7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:47.151313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:47.213277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77890a-f063-4190-8675-ddfe363bb1a7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:47.251086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce198-5fb4-46d8-b08b-05fbfa440fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:47.251730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce198-5fb4-46d8-b08b-05fbfa440fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:47.252048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce198-5fb4-46d8-b08b-05fbfa440fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:47.252336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce198-5fb4-46d8-b08b-05fbfa440fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:47.264754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ce198-5fb4-46d8-b08b-05fbfa440fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:47.266134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ce198-5fb4-46d8-b08b-05fbfa440fe1 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-cb0ce198-5fb4-46d8-b08b-05fbfa440fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:01:47.283534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:47.284744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:47.290539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:01:47.290539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:01:47.290539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:47.290539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:47.290539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 611/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:47.290878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e72c1-1404-4553-8b07-0a1fe323527d None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:47.400762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:47.404134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e72c1-1404-4553-8b07-0a1fe323527d None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:47.439751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b41d1-7e75-4b57-880a-96fa204973e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:47.440444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b41d1-7e75-4b57-880a-96fa204973e8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:47.440731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b41d1-7e75-4b57-880a-96fa204973e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:47.441025 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b41d1-7e75-4b57-880a-96fa204973e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:47.441732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b41d1-7e75-4b57-880a-96fa204973e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:47.442039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b41d1-7e75-4b57-880a-96fa204973e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:47.443455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b41d1-7e75-4b57-880a-96fa204973e8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:47.456636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 600/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:01:47.461557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce198-5fb4-46d8-b08b-05fbfa440fe1 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:47.576207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce198-5fb4-46d8-b08b-05fbfa440fe1 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:47.577769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:47.617395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ae920-1c2d-4969-9259-05d930c2b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:47.619077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ae920-1c2d-4969-9259-05d930c2b434 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:47.619515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ae920-1c2d-4969-9259-05d930c2b434 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:47.619970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ae920-1c2d-4969-9259-05d930c2b434 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:47.628417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ae920-1c2d-4969-9259-05d930c2b434 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:47.629868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ae920-1c2d-4969-9259-05d930c2b434 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-504ae920-1c2d-4969-9259-05d930c2b434 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 22:01:47.644762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:47.645836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:47.647486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 612/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 22:01:47.651750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b41d1-7e75-4b57-880a-96fa204973e8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:47.766910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b41d1-7e75-4b57-880a-96fa204973e8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:47.805726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab71051-de5e-4203-91f5-2c18b4b5b4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:47.806345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71051-de5e-4203-91f5-2c18b4b5b4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:47.806634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71051-de5e-4203-91f5-2c18b4b5b4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:47.807257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71051-de5e-4203-91f5-2c18b4b5b4e6 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:47.807762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab71051-de5e-4203-91f5-2c18b4b5b4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:47.808148 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab71051-de5e-4203-91f5-2c18b4b5b4e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:47.809805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab71051-de5e-4203-91f5-2c18b4b5b4e6 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:47.829421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 601/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 22:01:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:01:47.835728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ae920-1c2d-4969-9259-05d930c2b434 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:47.966160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ae920-1c2d-4969-9259-05d930c2b434 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:48.002371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633e72-8a4f-4096-9e19-652dea614439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:48.003258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633e72-8a4f-4096-9e19-652dea614439 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:48.003701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633e72-8a4f-4096-9e19-652dea614439 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:48.003975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633e72-8a4f-4096-9e19-652dea614439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:48.043947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:48.091016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b633e72-8a4f-4096-9e19-652dea614439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:48.093383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b633e72-8a4f-4096-9e19-652dea614439 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:48.228498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 613/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:01:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:01:48.234482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab71051-de5e-4203-91f5-2c18b4b5b4e6 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:48.260598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:48.368230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab71051-de5e-4203-91f5-2c18b4b5b4e6 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:48.410987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c790d-1451-4917-889f-1aae204fcbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:48.413695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c790d-1451-4917-889f-1aae204fcbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:48.413695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c790d-1451-4917-889f-1aae204fcbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:48.413695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c790d-1451-4917-889f-1aae204fcbb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:48.425397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c790d-1451-4917-889f-1aae204fcbb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:48.426974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c790d-1451-4917-889f-1aae204fcbb3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-0a5c790d-1451-4917-889f-1aae204fcbb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:01:48.446456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:48.447452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:48.448968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:01:48.448968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:01:48.448968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:48.448968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:01:48.448968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 602/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:48.454696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633e72-8a4f-4096-9e19-652dea614439 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:48.525620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:48.572798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633e72-8a4f-4096-9e19-652dea614439 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:48.616798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bedfc-f15c-40cb-9dc3-ae2c0c257b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:48.617458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bedfc-f15c-40cb-9dc3-ae2c0c257b25 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:48.618028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bedfc-f15c-40cb-9dc3-ae2c0c257b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:48.618028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bedfc-f15c-40cb-9dc3-ae2c0c257b25 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:48.618757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bedfc-f15c-40cb-9dc3-ae2c0c257b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:48.619061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bedfc-f15c-40cb-9dc3-ae2c0c257b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:48.620464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bedfc-f15c-40cb-9dc3-ae2c0c257b25 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:48.633265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 614/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:01:48.638959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c790d-1451-4917-889f-1aae204fcbb3 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:48.719978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:48.760344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c790d-1451-4917-889f-1aae204fcbb3 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:48.800318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570543-85cf-4678-8872-d7e0cd32f0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:48.800530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570543-85cf-4678-8872-d7e0cd32f0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:48.800890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570543-85cf-4678-8872-d7e0cd32f0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:48.801345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570543-85cf-4678-8872-d7e0cd32f0f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:48.808303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570543-85cf-4678-8872-d7e0cd32f0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:48.809916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570543-85cf-4678-8872-d7e0cd32f0f8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-47570543-85cf-4678-8872-d7e0cd32f0f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 22:01:48.823856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:48.825489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:48.826409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 22:01:48.826409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 22:01:48.826409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 22:01:48.826409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 22:01:48.826409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 22:01:48.826409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 22:01:48.826409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:01:48.826409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:01:48.826409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 603/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 22:01:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:48.831930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bedfc-f15c-40cb-9dc3-ae2c0c257b25 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:48.957338 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bedfc-f15c-40cb-9dc3-ae2c0c257b25 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:48.980818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:48.993753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c060ebe-28ac-4468-87ba-a5ce61e0de62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:48.994506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060ebe-28ac-4468-87ba-a5ce61e0de62 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:48.994870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060ebe-28ac-4468-87ba-a5ce61e0de62 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:48.995225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060ebe-28ac-4468-87ba-a5ce61e0de62 None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:48.996156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060ebe-28ac-4468-87ba-a5ce61e0de62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:48.996607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060ebe-28ac-4468-87ba-a5ce61e0de62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:48.999306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060ebe-28ac-4468-87ba-a5ce61e0de62 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:49.019220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 615/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 22:01:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:49.020641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570543-85cf-4678-8872-d7e0cd32f0f8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:49.131814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570543-85cf-4678-8872-d7e0cd32f0f8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:49.162911 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:49.169540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec654b72-063d-4882-838c-07bf21ace7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:49.170211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec654b72-063d-4882-838c-07bf21ace7ad None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:49.170494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec654b72-063d-4882-838c-07bf21ace7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:49.170774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec654b72-063d-4882-838c-07bf21ace7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:49.171619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec654b72-063d-4882-838c-07bf21ace7ad None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=1dd6827b3db547b58560a1d4f89e9c14) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:49.171955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec654b72-063d-4882-838c-07bf21ace7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:49.173664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec654b72-063d-4882-838c-07bf21ace7ad None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:49.179244 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 604/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:01:49 2022] GET /identity/v3/role_assignments?user.id=1dd6827b3db547b58560a1d4f89e9c14&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:51.237158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f811d6-1c72-4c56-8079-f3e9d2868c4b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:51.237853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f811d6-1c72-4c56-8079-f3e9d2868c4b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:51.237853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f811d6-1c72-4c56-8079-f3e9d2868c4b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:51.239625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 616/1220] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:01:51.245601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480b1cf-2753-4959-96f9-1ad73130a7d6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:51.246071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480b1cf-2753-4959-96f9-1ad73130a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:51.246265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480b1cf-2753-4959-96f9-1ad73130a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:51.264434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9480b1cf-2753-4959-96f9-1ad73130a7d6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:01:51.265691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9480b1cf-2753-4959-96f9-1ad73130a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:01:51.342436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 605/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:01:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 22:01:51.366004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f811d6-1c72-4c56-8079-f3e9d2868c4b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:51.481080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f811d6-1c72-4c56-8079-f3e9d2868c4b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:51.523775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd9f2-ef24-48ef-ac2b-3b41c4f79d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:51.524610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd9f2-ef24-48ef-ac2b-3b41c4f79d2b None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:51.524888 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd9f2-ef24-48ef-ac2b-3b41c4f79d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:51.525155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd9f2-ef24-48ef-ac2b-3b41c4f79d2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:51.538122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdd9f2-ef24-48ef-ac2b-3b41c4f79d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-edbdd9f2-ef24-48ef-ac2b-3b41c4f79d2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:01:51.547246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:51.548460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:51.549498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 617/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 22:01:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:51.555024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480b1cf-2753-4959-96f9-1ad73130a7d6 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:51.673628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480b1cf-2753-4959-96f9-1ad73130a7d6 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:51.701242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:51.715021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7befd0-5b60-496c-9784-185a9b88aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:51.716420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7befd0-5b60-496c-9784-185a9b88aff4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:51.716785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7befd0-5b60-496c-9784-185a9b88aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:51.717104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7befd0-5b60-496c-9784-185a9b88aff4 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:51.718035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7befd0-5b60-496c-9784-185a9b88aff4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:51.718401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7befd0-5b60-496c-9784-185a9b88aff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:51.720111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7befd0-5b60-496c-9784-185a9b88aff4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:51.728937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 606/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 22:01:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:51.734939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd9f2-ef24-48ef-ac2b-3b41c4f79d2b None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:51.789922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:51.858088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd9f2-ef24-48ef-ac2b-3b41c4f79d2b None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:51.894000 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cef2bc-e5d0-46ca-9a80-e2faa53d8e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:51.894807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef2bc-e5d0-46ca-9a80-e2faa53d8e9d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:51.895095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef2bc-e5d0-46ca-9a80-e2faa53d8e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:51.895379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef2bc-e5d0-46ca-9a80-e2faa53d8e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:51.907218 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cef2bc-e5d0-46ca-9a80-e2faa53d8e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:51.908903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cef2bc-e5d0-46ca-9a80-e2faa53d8e9d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-60cef2bc-e5d0-46ca-9a80-e2faa53d8e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:01:51.927056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:51.928130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:51.929033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:01:51.929033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:01:51.929033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:51.929033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:51.929033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 618/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:51.934127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7befd0-5b60-496c-9784-185a9b88aff4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:52.037405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7befd0-5b60-496c-9784-185a9b88aff4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:52.073663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12aa38-de3f-41ee-aa0d-b7cc65fdbc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:52.074330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12aa38-de3f-41ee-aa0d-b7cc65fdbc73 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:52.074680 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12aa38-de3f-41ee-aa0d-b7cc65fdbc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:52.075097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12aa38-de3f-41ee-aa0d-b7cc65fdbc73 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:52.076153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12aa38-de3f-41ee-aa0d-b7cc65fdbc73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:52.076470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12aa38-de3f-41ee-aa0d-b7cc65fdbc73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:52.077858 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12aa38-de3f-41ee-aa0d-b7cc65fdbc73 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:52.090292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 607/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:52.096766 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cef2bc-e5d0-46ca-9a80-e2faa53d8e9d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:52.197766 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:52.205702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cef2bc-e5d0-46ca-9a80-e2faa53d8e9d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:52.241483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eb89f-4ac2-43e8-8f3c-3f3604c0c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:52.242290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eb89f-4ac2-43e8-8f3c-3f3604c0c49d None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:52.242579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eb89f-4ac2-43e8-8f3c-3f3604c0c49d None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:52.242861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eb89f-4ac2-43e8-8f3c-3f3604c0c49d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:52.250546 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985eb89f-4ac2-43e8-8f3c-3f3604c0c49d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:52.252036 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985eb89f-4ac2-43e8-8f3c-3f3604c0c49d None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-985eb89f-4ac2-43e8-8f3c-3f3604c0c49d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 22:01:52.267812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:52.268823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:52.270117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 619/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:52.274810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12aa38-de3f-41ee-aa0d-b7cc65fdbc73 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:52.329906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:52.391087 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12aa38-de3f-41ee-aa0d-b7cc65fdbc73 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:52.428550 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80602a-30de-4430-8bd1-ab9b424d9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:52.429228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80602a-30de-4430-8bd1-ab9b424d9c65 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:52.429517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80602a-30de-4430-8bd1-ab9b424d9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:52.429793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80602a-30de-4430-8bd1-ab9b424d9c65 None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:52.430635 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80602a-30de-4430-8bd1-ab9b424d9c65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:52.430947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80602a-30de-4430-8bd1-ab9b424d9c65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:52.432420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80602a-30de-4430-8bd1-ab9b424d9c65 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:52.451739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 608/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 22:01:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:52.457730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eb89f-4ac2-43e8-8f3c-3f3604c0c49d None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:52.571563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eb89f-4ac2-43e8-8f3c-3f3604c0c49d None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:52.611957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa96dc-3b2e-4fdc-bdd5-528f471f043c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:52.612755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa96dc-3b2e-4fdc-bdd5-528f471f043c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:52.613040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa96dc-3b2e-4fdc-bdd5-528f471f043c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:52.613318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa96dc-3b2e-4fdc-bdd5-528f471f043c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:52.624087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa96dc-3b2e-4fdc-bdd5-528f471f043c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:52.625542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa96dc-3b2e-4fdc-bdd5-528f471f043c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-feaa96dc-3b2e-4fdc-bdd5-528f471f043c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:01:52.642923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:52.643941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:52.645001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:01:52.645001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:01:52.645001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:52.645001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:52.645001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 620/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 22:01:52.649969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80602a-30de-4430-8bd1-ab9b424d9c65 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:52.768807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80602a-30de-4430-8bd1-ab9b424d9c65 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:52.771687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:52.811477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822f009-81e2-4128-8260-ba38fd01ad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:52.812165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822f009-81e2-4128-8260-ba38fd01ad3b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:52.812452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822f009-81e2-4128-8260-ba38fd01ad3b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:52.812733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822f009-81e2-4128-8260-ba38fd01ad3b None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:52.813560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822f009-81e2-4128-8260-ba38fd01ad3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:52.813893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822f009-81e2-4128-8260-ba38fd01ad3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:52.815243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822f009-81e2-4128-8260-ba38fd01ad3b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:52.827295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 609/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:52.833394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa96dc-3b2e-4fdc-bdd5-528f471f043c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:52.844103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:52.946395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa96dc-3b2e-4fdc-bdd5-528f471f043c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:52.986234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c9fa4-6166-4911-b811-ea4ac2b28134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:52.987372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c9fa4-6166-4911-b811-ea4ac2b28134 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:52.987760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c9fa4-6166-4911-b811-ea4ac2b28134 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:52.988215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c9fa4-6166-4911-b811-ea4ac2b28134 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:52.996761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c9fa4-6166-4911-b811-ea4ac2b28134 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:52.999043 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c9fa4-6166-4911-b811-ea4ac2b28134 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-6a0c9fa4-6166-4911-b811-ea4ac2b28134 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 22:01:53.018551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:53.019829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:53.021196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 22:01:53.021196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 22:01:53.021196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 22:01:53.021196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 22:01:53.021196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 22:01:53.021196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 22:01:53.021196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:01:53.021196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:53.021196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 621/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 22:01:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:53.026877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822f009-81e2-4128-8260-ba38fd01ad3b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:53.139851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822f009-81e2-4128-8260-ba38fd01ad3b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:53.177005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1375c60-fbeb-423b-905a-c7e69fbd1bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:53.177709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1375c60-fbeb-423b-905a-c7e69fbd1bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:53.178020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1375c60-fbeb-423b-905a-c7e69fbd1bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:53.178320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1375c60-fbeb-423b-905a-c7e69fbd1bc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:53.179118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1375c60-fbeb-423b-905a-c7e69fbd1bc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:53.179470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1375c60-fbeb-423b-905a-c7e69fbd1bc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:53.180980 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1375c60-fbeb-423b-905a-c7e69fbd1bc4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:53.195807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 610/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 22:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:53.203810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c9fa4-6166-4911-b811-ea4ac2b28134 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:53.276753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:53.316770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c9fa4-6166-4911-b811-ea4ac2b28134 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:53.360231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d80cc-cf74-4112-8b0b-ec662b97cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:53.361135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d80cc-cf74-4112-8b0b-ec662b97cd70 None admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:53.361419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d80cc-cf74-4112-8b0b-ec662b97cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:53.361710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d80cc-cf74-4112-8b0b-ec662b97cd70 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/1dd6827b3db547b58560a1d4f89e9c14/roles/c45ff064e30a4a689212d6aee4ed3dd7` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:53.377647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d80cc-cf74-4112-8b0b-ec662b97cd70 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=1dd6827b3db547b58560a1d4f89e9c14, role_id=c45ff064e30a4a689212d6aee4ed3dd7)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:53.379211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d80cc-cf74-4112-8b0b-ec662b97cd70 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:53.392029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 622/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 22:01:53 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/1dd6827b3db547b58560a1d4f89e9c14/roles/c45ff064e30a4a689212d6aee4ed3dd7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:01:55.544751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f08a-165b-411a-9390-e16eb58d60d6 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:55.545425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f08a-165b-411a-9390-e16eb58d60d6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:55.545425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f08a-165b-411a-9390-e16eb58d60d6 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:55.546833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 611/1233] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:01:55.551794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604ee88-8c7e-4288-b6b3-305f60c9de11 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:55.552259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604ee88-8c7e-4288-b6b3-305f60c9de11 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:55.552390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604ee88-8c7e-4288-b6b3-305f60c9de11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:55.570060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e604ee88-8c7e-4288-b6b3-305f60c9de11 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:01:55.571289 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e604ee88-8c7e-4288-b6b3-305f60c9de11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:01:55.641627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 623/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:01:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:01:55.669118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44f08a-165b-411a-9390-e16eb58d60d6 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:55.697608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:55.781228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44f08a-165b-411a-9390-e16eb58d60d6 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:55.821846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0867450-e5c4-4cfb-9298-446389a462db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:55.822708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0867450-e5c4-4cfb-9298-446389a462db None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:55.823312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0867450-e5c4-4cfb-9298-446389a462db None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:55.823687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0867450-e5c4-4cfb-9298-446389a462db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:55.835235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0867450-e5c4-4cfb-9298-446389a462db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-a0867450-e5c4-4cfb-9298-446389a462db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:01:55.843134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:55.844283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:01:55.845254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 612/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 22:01:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:55.851304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604ee88-8c7e-4288-b6b3-305f60c9de11 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:55.902404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:55.958640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604ee88-8c7e-4288-b6b3-305f60c9de11 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:55.993281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd5765-283f-4a97-a682-34924742d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:55.993947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd5765-283f-4a97-a682-34924742d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:55.994225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd5765-283f-4a97-a682-34924742d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:55.994498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd5765-283f-4a97-a682-34924742d9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:55.995240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd5765-283f-4a97-a682-34924742d9e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:55.995544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd5765-283f-4a97-a682-34924742d9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:55.997564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd5765-283f-4a97-a682-34924742d9e0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:56.006234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 624/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 22:01:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:56.013224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0867450-e5c4-4cfb-9298-446389a462db None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:56.102388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:56.119794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0867450-e5c4-4cfb-9298-446389a462db None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:56.157726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bccd40-9a58-46b9-9486-e74ee31af26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:56.158866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bccd40-9a58-46b9-9486-e74ee31af26e None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:56.159199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bccd40-9a58-46b9-9486-e74ee31af26e None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:56.159485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bccd40-9a58-46b9-9486-e74ee31af26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:56.171999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bccd40-9a58-46b9-9486-e74ee31af26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:56.173426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bccd40-9a58-46b9-9486-e74ee31af26e None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-42bccd40-9a58-46b9-9486-e74ee31af26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:01:56.191452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:56.192646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:56.193819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:01:56.193819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:01:56.193819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:56.193819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:01:56.193819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 613/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:56.198700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd5765-283f-4a97-a682-34924742d9e0 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:56.308528 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd5765-283f-4a97-a682-34924742d9e0 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:56.319213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:56.345565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568077db-6ae7-45bf-9bbd-aa8e2ee64b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:56.346272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568077db-6ae7-45bf-9bbd-aa8e2ee64b27 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:56.346613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568077db-6ae7-45bf-9bbd-aa8e2ee64b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:56.346853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568077db-6ae7-45bf-9bbd-aa8e2ee64b27 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:56.347643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568077db-6ae7-45bf-9bbd-aa8e2ee64b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:56.347988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568077db-6ae7-45bf-9bbd-aa8e2ee64b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:56.349425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568077db-6ae7-45bf-9bbd-aa8e2ee64b27 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:56.363259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 625/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:56.368792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bccd40-9a58-46b9-9486-e74ee31af26e None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:56.487314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bccd40-9a58-46b9-9486-e74ee31af26e None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:56.525542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6f40-7977-42b8-9457-19edfddba10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:56.526343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6f40-7977-42b8-9457-19edfddba10c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:56.526625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6f40-7977-42b8-9457-19edfddba10c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:56.526901 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6f40-7977-42b8-9457-19edfddba10c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:56.530135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:56.535576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca6f40-7977-42b8-9457-19edfddba10c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:56.537851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca6f40-7977-42b8-9457-19edfddba10c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-71ca6f40-7977-42b8-9457-19edfddba10c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 22:01:56.559157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:56.561512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:01:56.563000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 614/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:56.566735 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568077db-6ae7-45bf-9bbd-aa8e2ee64b27 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:56.673507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568077db-6ae7-45bf-9bbd-aa8e2ee64b27 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:56.709498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432f574-1d1f-4545-b93a-a4472e10a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:56.710177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432f574-1d1f-4545-b93a-a4472e10a2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:56.710466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432f574-1d1f-4545-b93a-a4472e10a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:56.710747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432f574-1d1f-4545-b93a-a4472e10a2f6 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:56.711697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432f574-1d1f-4545-b93a-a4472e10a2f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:56.711967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432f574-1d1f-4545-b93a-a4472e10a2f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:56.713530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432f574-1d1f-4545-b93a-a4472e10a2f6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:56.733719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 626/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 22:01:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:56.739628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6f40-7977-42b8-9457-19edfddba10c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:56.849647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6f40-7977-42b8-9457-19edfddba10c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:56.890902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf627f2-ed25-4456-9753-faee840d6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:56.891562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf627f2-ed25-4456-9753-faee840d6c85 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:56.891851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf627f2-ed25-4456-9753-faee840d6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:56.892210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf627f2-ed25-4456-9753-faee840d6c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:56.958224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:56.965539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf627f2-ed25-4456-9753-faee840d6c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:56.967537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf627f2-ed25-4456-9753-faee840d6c85 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:57.074996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 615/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:01:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:01:57.083087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432f574-1d1f-4545-b93a-a4472e10a2f6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:57.115814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:57.199330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432f574-1d1f-4545-b93a-a4472e10a2f6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:57.236779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82565059-8597-44ea-a005-52f70c348a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:57.237609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82565059-8597-44ea-a005-52f70c348a18 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:57.237860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82565059-8597-44ea-a005-52f70c348a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:57.238139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82565059-8597-44ea-a005-52f70c348a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:57.248488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82565059-8597-44ea-a005-52f70c348a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:57.249992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82565059-8597-44ea-a005-52f70c348a18 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-82565059-8597-44ea-a005-52f70c348a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:01:57.269065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:57.270182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:57.271339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:01:57.271339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:01:57.271339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:01:57.271339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:57.271339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 627/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 22:01:57.276108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf627f2-ed25-4456-9753-faee840d6c85 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:57.373637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:57.380238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf627f2-ed25-4456-9753-faee840d6c85 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:57.417462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df8ed4-dc34-4188-9e72-04b6dcf28a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:57.418130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df8ed4-dc34-4188-9e72-04b6dcf28a78 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:57.418419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df8ed4-dc34-4188-9e72-04b6dcf28a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:57.418699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df8ed4-dc34-4188-9e72-04b6dcf28a78 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:57.420426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df8ed4-dc34-4188-9e72-04b6dcf28a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:57.420739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df8ed4-dc34-4188-9e72-04b6dcf28a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:57.422104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df8ed4-dc34-4188-9e72-04b6dcf28a78 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:57.434557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 616/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:01:57.440980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82565059-8597-44ea-a005-52f70c348a18 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:57.532777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:01:57.558996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82565059-8597-44ea-a005-52f70c348a18 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:57.599456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378645-c789-4ace-bd8a-f364588ff195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:57.600302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378645-c789-4ace-bd8a-f364588ff195 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:57.600588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378645-c789-4ace-bd8a-f364588ff195 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:57.600868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378645-c789-4ace-bd8a-f364588ff195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:57.608015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378645-c789-4ace-bd8a-f364588ff195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:57.609716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378645-c789-4ace-bd8a-f364588ff195 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-4f378645-c789-4ace-bd8a-f364588ff195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 22:01:57.623962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:01:57.625395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:01:57.626683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 22:01:57.626683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 22:01:57.626683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 22:01:57.626683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 22:01:57.626683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 22:01:57.626683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 22:01:57.626683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:01:57.626683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:01:57.626683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 628/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 22:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:01:57.631179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df8ed4-dc34-4188-9e72-04b6dcf28a78 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:57.740008 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df8ed4-dc34-4188-9e72-04b6dcf28a78 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:57.779488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979c2ed-4871-47c2-8f94-c8b17a9c63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:57.780121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979c2ed-4871-47c2-8f94-c8b17a9c63b9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:57.780408 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979c2ed-4871-47c2-8f94-c8b17a9c63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:57.780675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979c2ed-4871-47c2-8f94-c8b17a9c63b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:57.781568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979c2ed-4871-47c2-8f94-c8b17a9c63b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:57.781798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979c2ed-4871-47c2-8f94-c8b17a9c63b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:57.783408 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979c2ed-4871-47c2-8f94-c8b17a9c63b9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:57.797202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 617/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 22:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:01:57.803348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378645-c789-4ace-bd8a-f364588ff195 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:01:57.914221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378645-c789-4ace-bd8a-f364588ff195 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:01:57.953628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09578b-c42d-4c45-b585-c4354c4abead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:01:57.954278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09578b-c42d-4c45-b585-c4354c4abead None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:01:57.954564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09578b-c42d-4c45-b585-c4354c4abead None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:01:57.954844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09578b-c42d-4c45-b585-c4354c4abead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:01:57.955674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09578b-c42d-4c45-b585-c4354c4abead None admin] RBAC: Adding query filter params (role.id=c45ff064e30a4a689212d6aee4ed3dd7, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=1dd6827b3db547b58560a1d4f89e9c14) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:01:57.956020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09578b-c42d-4c45-b585-c4354c4abead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:01:57.957707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09578b-c42d-4c45-b585-c4354c4abead None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:01:57.963488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 629/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:01:57 2022] GET /identity/v3/role_assignments?user.id=1dd6827b3db547b58560a1d4f89e9c14&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=c45ff064e30a4a689212d6aee4ed3dd7 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:00.068520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f751f72-3316-4d37-a731-df1bb7f0e56b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:00.069227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f751f72-3316-4d37-a731-df1bb7f0e56b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:00.069227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f751f72-3316-4d37-a731-df1bb7f0e56b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:00.070486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 618/1247] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:02:00.075793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6533-a85f-4ec8-b4b3-3788db5395a9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:00.076389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6533-a85f-4ec8-b4b3-3788db5395a9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:00.076389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6533-a85f-4ec8-b4b3-3788db5395a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:00.081912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:00.096700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-11ff6533-a85f-4ec8-b4b3-3788db5395a9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:02:00.098095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-11ff6533-a85f-4ec8-b4b3-3788db5395a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:02:00.179461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 630/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:02:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:02:00.204680 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f751f72-3316-4d37-a731-df1bb7f0e56b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:00.226516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:00.323158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f751f72-3316-4d37-a731-df1bb7f0e56b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:00.362134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911b03-2170-4200-98dc-5943ac88d173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:00.363622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911b03-2170-4200-98dc-5943ac88d173 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:00.363622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911b03-2170-4200-98dc-5943ac88d173 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:00.363622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911b03-2170-4200-98dc-5943ac88d173 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:00.374787 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70911b03-2170-4200-98dc-5943ac88d173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-70911b03-2170-4200-98dc-5943ac88d173 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:02:00.382499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:00.383622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:02:00.384601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:00.388854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 619/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:02:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:00.389819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6533-a85f-4ec8-b4b3-3788db5395a9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:00.511884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6533-a85f-4ec8-b4b3-3788db5395a9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:00.551654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:00.557394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427aa55-7810-4fe3-8d9f-bb1f47968945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:00.558070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427aa55-7810-4fe3-8d9f-bb1f47968945 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:00.558362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427aa55-7810-4fe3-8d9f-bb1f47968945 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:00.558647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427aa55-7810-4fe3-8d9f-bb1f47968945 None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:00.559401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427aa55-7810-4fe3-8d9f-bb1f47968945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:00.560383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427aa55-7810-4fe3-8d9f-bb1f47968945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:00.562451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427aa55-7810-4fe3-8d9f-bb1f47968945 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:00.572357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 631/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:00.578986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911b03-2170-4200-98dc-5943ac88d173 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:00.666538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:00.694883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911b03-2170-4200-98dc-5943ac88d173 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:00.735008 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56311fe1-3e65-4091-a694-308c6247361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:00.735809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56311fe1-3e65-4091-a694-308c6247361a None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:00.736143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56311fe1-3e65-4091-a694-308c6247361a None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:00.736428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56311fe1-3e65-4091-a694-308c6247361a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:00.749012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56311fe1-3e65-4091-a694-308c6247361a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:00.750884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56311fe1-3e65-4091-a694-308c6247361a None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-56311fe1-3e65-4091-a694-308c6247361a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:02:00.768096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:00.769242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:00.770156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:02:00.770156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:02:00.770156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:00.770156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:00.770156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 620/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 22:02:00.775013 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427aa55-7810-4fe3-8d9f-bb1f47968945 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:00.898490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427aa55-7810-4fe3-8d9f-bb1f47968945 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:00.935751 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fce3d-cbf3-430e-8be5-9c842bf6af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:00.936418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fce3d-cbf3-430e-8be5-9c842bf6af97 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:00.936714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fce3d-cbf3-430e-8be5-9c842bf6af97 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:00.937002 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fce3d-cbf3-430e-8be5-9c842bf6af97 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:00.937744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fce3d-cbf3-430e-8be5-9c842bf6af97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:00.938060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fce3d-cbf3-430e-8be5-9c842bf6af97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:00.939473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fce3d-cbf3-430e-8be5-9c842bf6af97 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:00.952198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 632/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:00.958209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56311fe1-3e65-4091-a694-308c6247361a None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:01.076998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56311fe1-3e65-4091-a694-308c6247361a None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:01.110172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:01.119669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cece88-9f98-4890-be5a-b3ae237eb1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:01.120656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cece88-9f98-4890-be5a-b3ae237eb1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:01.121073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cece88-9f98-4890-be5a-b3ae237eb1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:01.121481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cece88-9f98-4890-be5a-b3ae237eb1a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:01.131156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cece88-9f98-4890-be5a-b3ae237eb1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:01.134174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cece88-9f98-4890-be5a-b3ae237eb1a8 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-61cece88-9f98-4890-be5a-b3ae237eb1a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 22:02:01.152232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:01.154026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:01.154998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 621/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:02:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:01.160292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fce3d-cbf3-430e-8be5-9c842bf6af97 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:01.223059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:01.272468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fce3d-cbf3-430e-8be5-9c842bf6af97 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:01.311265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead288af-c12a-4aac-91d3-d1c49c5b9dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:01.312102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead288af-c12a-4aac-91d3-d1c49c5b9dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:01.312281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead288af-c12a-4aac-91d3-d1c49c5b9dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:01.312556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead288af-c12a-4aac-91d3-d1c49c5b9dc3 None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:01.313420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead288af-c12a-4aac-91d3-d1c49c5b9dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:01.313734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead288af-c12a-4aac-91d3-d1c49c5b9dc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:01.315175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead288af-c12a-4aac-91d3-d1c49c5b9dc3 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:01.335802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 633/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 22:02:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:02:01.342855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cece88-9f98-4890-be5a-b3ae237eb1a8 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:01.451323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cece88-9f98-4890-be5a-b3ae237eb1a8 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:01.489951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f5334-8b2b-48e5-b808-6b84ad0d0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:01.490663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5334-8b2b-48e5-b808-6b84ad0d0579 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:01.490988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5334-8b2b-48e5-b808-6b84ad0d0579 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:01.491267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5334-8b2b-48e5-b808-6b84ad0d0579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:01.553077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:01.567236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f5334-8b2b-48e5-b808-6b84ad0d0579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:01.568800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f5334-8b2b-48e5-b808-6b84ad0d0579 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:01.681371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 622/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:02:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:02:01.687828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead288af-c12a-4aac-91d3-d1c49c5b9dc3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:01.800865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead288af-c12a-4aac-91d3-d1c49c5b9dc3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:01.815682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:01.842462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1eaa-1fe9-45a2-85a7-c87beaccbc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:01.843348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1eaa-1fe9-45a2-85a7-c87beaccbc53 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:01.843532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1eaa-1fe9-45a2-85a7-c87beaccbc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:01.843816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1eaa-1fe9-45a2-85a7-c87beaccbc53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:01.855035 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed1eaa-1fe9-45a2-85a7-c87beaccbc53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:01.856584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed1eaa-1fe9-45a2-85a7-c87beaccbc53 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-54ed1eaa-1fe9-45a2-85a7-c87beaccbc53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:02:01.877348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:01.878594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:01.879658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:02:01.879658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:02:01.879658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:01.879658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:01.879658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 634/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:01.884572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f5334-8b2b-48e5-b808-6b84ad0d0579 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:01.984061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:02.000058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f5334-8b2b-48e5-b808-6b84ad0d0579 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:02.035704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d90e6-b34e-4f9f-a444-7c40e08d4496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:02.036495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d90e6-b34e-4f9f-a444-7c40e08d4496 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:02.036719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d90e6-b34e-4f9f-a444-7c40e08d4496 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:02.037043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d90e6-b34e-4f9f-a444-7c40e08d4496 None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:02.037782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d90e6-b34e-4f9f-a444-7c40e08d4496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:02.038133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d90e6-b34e-4f9f-a444-7c40e08d4496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:02.039638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d90e6-b34e-4f9f-a444-7c40e08d4496 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:02.051995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 623/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:02.058231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1eaa-1fe9-45a2-85a7-c87beaccbc53 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:02.168504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1eaa-1fe9-45a2-85a7-c87beaccbc53 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:02.203266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498997e-37bf-4feb-a567-936226cb3ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:02.204442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498997e-37bf-4feb-a567-936226cb3ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:02.204738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498997e-37bf-4feb-a567-936226cb3ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:02.205022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498997e-37bf-4feb-a567-936226cb3ed7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:02.212116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498997e-37bf-4feb-a567-936226cb3ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:02.213554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498997e-37bf-4feb-a567-936226cb3ed7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-e498997e-37bf-4feb-a567-936226cb3ed7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 22:02:02.230517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:02.232944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:02.234925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 22:02:02.234925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 22:02:02.234925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 22:02:02.234925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 22:02:02.234925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 22:02:02.234925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 22:02:02.234925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:02:02.234925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:02.234925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 635/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 22:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:02.239876 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d90e6-b34e-4f9f-a444-7c40e08d4496 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:02.354028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d90e6-b34e-4f9f-a444-7c40e08d4496 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:02.398861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd487c3a-1c19-4b29-b163-2d012cf9f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:02.399573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd487c3a-1c19-4b29-b163-2d012cf9f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:02.399861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd487c3a-1c19-4b29-b163-2d012cf9f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:02.400190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd487c3a-1c19-4b29-b163-2d012cf9f3e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:02.401012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd487c3a-1c19-4b29-b163-2d012cf9f3e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:02.401353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd487c3a-1c19-4b29-b163-2d012cf9f3e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:02.402789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd487c3a-1c19-4b29-b163-2d012cf9f3e4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:02.414940 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 624/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 22:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:02.422100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498997e-37bf-4feb-a567-936226cb3ed7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:02.448902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:02.534780 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498997e-37bf-4feb-a567-936226cb3ed7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:02.575056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098441ad-c83d-47e1-81d9-daebf52ecda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:02.575821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098441ad-c83d-47e1-81d9-daebf52ecda0 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:02.576139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098441ad-c83d-47e1-81d9-daebf52ecda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:02.576423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098441ad-c83d-47e1-81d9-daebf52ecda0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:02.577514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098441ad-c83d-47e1-81d9-daebf52ecda0 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=1dd6827b3db547b58560a1d4f89e9c14) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:02.578134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098441ad-c83d-47e1-81d9-daebf52ecda0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:02.580563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098441ad-c83d-47e1-81d9-daebf52ecda0 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:02.589082 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 636/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:02:02 2022] GET /identity/v3/role_assignments?user.id=1dd6827b3db547b58560a1d4f89e9c14&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:04.622953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076157ac-6b3f-4dcc-a34b-9f14ab8af0f6 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:04.623483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076157ac-6b3f-4dcc-a34b-9f14ab8af0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:04.623483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076157ac-6b3f-4dcc-a34b-9f14ab8af0f6 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:04.624905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 625/1261] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:02:04.629975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a36cf-8a05-4176-a46e-1ddfa1b21fb6 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:04.630410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a36cf-8a05-4176-a46e-1ddfa1b21fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:04.630527 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a36cf-8a05-4176-a46e-1ddfa1b21fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:04.647163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-931a36cf-8a05-4176-a46e-1ddfa1b21fb6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:02:04.648369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-931a36cf-8a05-4176-a46e-1ddfa1b21fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:02:04.712801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 637/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:02:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 22:02:04.734928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076157ac-6b3f-4dcc-a34b-9f14ab8af0f6 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:04.746047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:04.838547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076157ac-6b3f-4dcc-a34b-9f14ab8af0f6 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:04.870832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28cd95-1738-47ee-8456-8356d898ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:04.871615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28cd95-1738-47ee-8456-8356d898ede4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:04.871927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28cd95-1738-47ee-8456-8356d898ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:04.872726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28cd95-1738-47ee-8456-8356d898ede4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:04.887346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28cd95-1738-47ee-8456-8356d898ede4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-5a28cd95-1738-47ee-8456-8356d898ede4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:02:04.895948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:04.897135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:04.898298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 626/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:04.903502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a36cf-8a05-4176-a46e-1ddfa1b21fb6 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:04.925208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:05.002945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a36cf-8a05-4176-a46e-1ddfa1b21fb6 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:05.035394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a54b13-e2f3-4152-80c2-29f9640ef8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:05.036075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a54b13-e2f3-4152-80c2-29f9640ef8ce None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:05.036362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a54b13-e2f3-4152-80c2-29f9640ef8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:05.036645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a54b13-e2f3-4152-80c2-29f9640ef8ce None admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:05.037388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a54b13-e2f3-4152-80c2-29f9640ef8ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:05.037695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a54b13-e2f3-4152-80c2-29f9640ef8ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:05.039071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a54b13-e2f3-4152-80c2-29f9640ef8ce None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:05.046916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 638/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:02:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:05.052475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28cd95-1738-47ee-8456-8356d898ede4 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:05.118068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:05.152313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28cd95-1738-47ee-8456-8356d898ede4 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:05.187192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444334d8-2d5e-4039-b4fc-0df827417404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:05.188012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444334d8-2d5e-4039-b4fc-0df827417404 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:05.188302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444334d8-2d5e-4039-b4fc-0df827417404 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:05.188583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444334d8-2d5e-4039-b4fc-0df827417404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:05.198872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444334d8-2d5e-4039-b4fc-0df827417404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:05.200344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444334d8-2d5e-4039-b4fc-0df827417404 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-444334d8-2d5e-4039-b4fc-0df827417404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:02:05.218164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:05.219084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:05.220135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:02:05.220135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:02:05.220135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:05.220135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:05.220135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 627/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:05.225199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a54b13-e2f3-4152-80c2-29f9640ef8ce None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:05.306126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:05.325999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a54b13-e2f3-4152-80c2-29f9640ef8ce None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:05.358209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ff65a-f7d5-42c3-b491-018925c155b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:05.358855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ff65a-f7d5-42c3-b491-018925c155b6 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:05.359140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ff65a-f7d5-42c3-b491-018925c155b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:05.359415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ff65a-f7d5-42c3-b491-018925c155b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:05.360153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ff65a-f7d5-42c3-b491-018925c155b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:05.360457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ff65a-f7d5-42c3-b491-018925c155b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:05.361815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ff65a-f7d5-42c3-b491-018925c155b6 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:05.373601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 639/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:05.379236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444334d8-2d5e-4039-b4fc-0df827417404 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:05.474982 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444334d8-2d5e-4039-b4fc-0df827417404 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:05.493900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:05.507481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97bea8-b243-4a3d-b11e-c4f160af8a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:05.508291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97bea8-b243-4a3d-b11e-c4f160af8a29 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:05.508574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97bea8-b243-4a3d-b11e-c4f160af8a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:05.508849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97bea8-b243-4a3d-b11e-c4f160af8a29 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:05.516114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97bea8-b243-4a3d-b11e-c4f160af8a29 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:05.517531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97bea8-b243-4a3d-b11e-c4f160af8a29 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-8a97bea8-b243-4a3d-b11e-c4f160af8a29 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 22:02:05.531926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:05.533013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:05.534157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 628/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:02:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:05.538932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ff65a-f7d5-42c3-b491-018925c155b6 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:05.634639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ff65a-f7d5-42c3-b491-018925c155b6 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:05.667156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e9237-188f-40f5-9e4b-1a6fc170637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:05.667816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e9237-188f-40f5-9e4b-1a6fc170637c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:05.668127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e9237-188f-40f5-9e4b-1a6fc170637c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:05.668402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e9237-188f-40f5-9e4b-1a6fc170637c None admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:05.669230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e9237-188f-40f5-9e4b-1a6fc170637c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:05.669532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e9237-188f-40f5-9e4b-1a6fc170637c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:05.670940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e9237-188f-40f5-9e4b-1a6fc170637c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:05.679232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:05.688096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 640/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 22:02:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:05.693651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97bea8-b243-4a3d-b11e-c4f160af8a29 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:05.793598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97bea8-b243-4a3d-b11e-c4f160af8a29 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:05.831187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6d9a6-efaf-45a9-91a4-410bb6228ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:05.832263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6d9a6-efaf-45a9-91a4-410bb6228ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:05.832544 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6d9a6-efaf-45a9-91a4-410bb6228ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:05.832817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6d9a6-efaf-45a9-91a4-410bb6228ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:05.842977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6d9a6-efaf-45a9-91a4-410bb6228ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:05.844422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6d9a6-efaf-45a9-91a4-410bb6228ee0 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-bbe6d9a6-efaf-45a9-91a4-410bb6228ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:02:05.861267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:05.862296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:05.863262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:02:05.863262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:02:05.863262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:05.863262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:05.863262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 629/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:05.868147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e9237-188f-40f5-9e4b-1a6fc170637c None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:05.962971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e9237-188f-40f5-9e4b-1a6fc170637c None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:05.995923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8932f-7384-4119-bdea-f1a448ff1181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:05.996598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8932f-7384-4119-bdea-f1a448ff1181 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:05.996884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8932f-7384-4119-bdea-f1a448ff1181 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:05.997164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8932f-7384-4119-bdea-f1a448ff1181 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:05.998096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8932f-7384-4119-bdea-f1a448ff1181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:05.998403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8932f-7384-4119-bdea-f1a448ff1181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:05.999767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8932f-7384-4119-bdea-f1a448ff1181 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:06.010841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 641/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:06.016950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6d9a6-efaf-45a9-91a4-410bb6228ee0 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:06.047844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:06.113324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6d9a6-efaf-45a9-91a4-410bb6228ee0 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:06.145722 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df36a-a170-49f6-b538-db10532e0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:06.146504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df36a-a170-49f6-b538-db10532e0503 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:06.146785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df36a-a170-49f6-b538-db10532e0503 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:06.147059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df36a-a170-49f6-b538-db10532e0503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:06.153405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df36a-a170-49f6-b538-db10532e0503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:06.155405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df36a-a170-49f6-b538-db10532e0503 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-9d8df36a-a170-49f6-b538-db10532e0503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 22:02:06.169141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:06.170209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:06.171324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 22:02:06.171324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 22:02:06.171324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 22:02:06.171324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 22:02:06.171324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 22:02:06.171324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 22:02:06.171324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:02:06.171324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:06.171324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 630/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 22:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:06.176096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8932f-7384-4119-bdea-f1a448ff1181 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:06.234009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:06.275068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8932f-7384-4119-bdea-f1a448ff1181 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:06.306614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd1ae7-e95a-4b66-a5a3-8cba8fbdd67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:06.307203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1ae7-e95a-4b66-a5a3-8cba8fbdd67c None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:06.307489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1ae7-e95a-4b66-a5a3-8cba8fbdd67c None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:06.307769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1ae7-e95a-4b66-a5a3-8cba8fbdd67c None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:06.308581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd1ae7-e95a-4b66-a5a3-8cba8fbdd67c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:06.308899 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd1ae7-e95a-4b66-a5a3-8cba8fbdd67c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:06.310329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd1ae7-e95a-4b66-a5a3-8cba8fbdd67c None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:06.322946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 642/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 22:02:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:06.329472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df36a-a170-49f6-b538-db10532e0503 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:06.417669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:06.426935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df36a-a170-49f6-b538-db10532e0503 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:06.463039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99242fe-b238-4f84-aaad-4c3265da6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:06.463952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99242fe-b238-4f84-aaad-4c3265da6e58 None admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:06.464245 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99242fe-b238-4f84-aaad-4c3265da6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:06.464530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99242fe-b238-4f84-aaad-4c3265da6e58 None admin] PATH_INFO: `/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/1dd6827b3db547b58560a1d4f89e9c14/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:06.466467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99242fe-b238-4f84-aaad-4c3265da6e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e14f6463d4f46b0b2a1dba49254cbad, user_id=1dd6827b3db547b58560a1d4f89e9c14, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:06.468381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99242fe-b238-4f84-aaad-4c3265da6e58 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:06.481499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 631/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 22:02:06 2022] PUT /identity/v3/projects/7e14f6463d4f46b0b2a1dba49254cbad/users/1dd6827b3db547b58560a1d4f89e9c14/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:02:08.482249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f55973-81d5-41de-96ce-d4c92f095668 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:08.482761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f55973-81d5-41de-96ce-d4c92f095668 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:08.482905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f55973-81d5-41de-96ce-d4c92f095668 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:08.484292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 643/1274] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:02:08.489390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814ab1-de4c-4a2e-bb17-ab3c22c297b3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:08.489804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814ab1-de4c-4a2e-bb17-ab3c22c297b3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:08.489961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814ab1-de4c-4a2e-bb17-ab3c22c297b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:08.506762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-79814ab1-de4c-4a2e-bb17-ab3c22c297b3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:02:08.507988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-79814ab1-de4c-4a2e-bb17-ab3c22c297b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:02:08.578781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 632/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:02:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 22:02:08.602536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f55973-81d5-41de-96ce-d4c92f095668 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:08.704158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f55973-81d5-41de-96ce-d4c92f095668 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:08.722659 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:08.739499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077efbe-79f7-4d62-bb6c-834ffb4b7fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:08.740248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077efbe-79f7-4d62-bb6c-834ffb4b7fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:08.740537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077efbe-79f7-4d62-bb6c-834ffb4b7fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:08.740817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077efbe-79f7-4d62-bb6c-834ffb4b7fe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:08.751653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077efbe-79f7-4d62-bb6c-834ffb4b7fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-8077efbe-79f7-4d62-bb6c-834ffb4b7fe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 22:02:08.759283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:08.760301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:08.761322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 644/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 22:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:08.770409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79814ab1-de4c-4a2e-bb17-ab3c22c297b3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:08.863432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:08.884139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79814ab1-de4c-4a2e-bb17-ab3c22c297b3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:08.915950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e2b61-7efa-4387-ad85-98bd7486e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:08.916612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e2b61-7efa-4387-ad85-98bd7486e760 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:08.916897 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e2b61-7efa-4387-ad85-98bd7486e760 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:08.917176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e2b61-7efa-4387-ad85-98bd7486e760 None admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:08.917914 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e2b61-7efa-4387-ad85-98bd7486e760 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:08.918222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e2b61-7efa-4387-ad85-98bd7486e760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:08.919576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e2b61-7efa-4387-ad85-98bd7486e760 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:08.927840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 633/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 22:02:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:08.933792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077efbe-79f7-4d62-bb6c-834ffb4b7fe3 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:09.031190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077efbe-79f7-4d62-bb6c-834ffb4b7fe3 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:09.064059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409502e9-09f6-42d9-afe9-3be6d3e479ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:09.064837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409502e9-09f6-42d9-afe9-3be6d3e479ae None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:09.065123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409502e9-09f6-42d9-afe9-3be6d3e479ae None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:09.065402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409502e9-09f6-42d9-afe9-3be6d3e479ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:09.075524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409502e9-09f6-42d9-afe9-3be6d3e479ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:09.077041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409502e9-09f6-42d9-afe9-3be6d3e479ae None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-409502e9-09f6-42d9-afe9-3be6d3e479ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:02:09.094022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:09.095071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:09.096212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:02:09.096212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:02:09.096212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:09.096212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:09.096212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 645/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:09.100799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e2b61-7efa-4387-ad85-98bd7486e760 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:09.200369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e2b61-7efa-4387-ad85-98bd7486e760 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:09.233949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9f62-9209-4902-a4c8-faab2c30265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:09.234612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9f62-9209-4902-a4c8-faab2c30265c None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:09.234901 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9f62-9209-4902-a4c8-faab2c30265c None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:09.235183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9f62-9209-4902-a4c8-faab2c30265c None admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:09.235925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be9f62-9209-4902-a4c8-faab2c30265c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:09.236237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be9f62-9209-4902-a4c8-faab2c30265c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:09.237589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be9f62-9209-4902-a4c8-faab2c30265c None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:09.249867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 634/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:09.255464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409502e9-09f6-42d9-afe9-3be6d3e479ae None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:09.285708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:09.351799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409502e9-09f6-42d9-afe9-3be6d3e479ae None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:09.383616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c27de-275d-4b35-b65f-7ac83377c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:09.384429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c27de-275d-4b35-b65f-7ac83377c4ec None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:09.384718 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c27de-275d-4b35-b65f-7ac83377c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:09.384998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c27de-275d-4b35-b65f-7ac83377c4ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:09.392126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c27de-275d-4b35-b65f-7ac83377c4ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:09.393558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c27de-275d-4b35-b65f-7ac83377c4ec None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-547c27de-275d-4b35-b65f-7ac83377c4ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 22:02:09.408185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:09.409260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:09.410202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 646/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:02:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:09.414966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9f62-9209-4902-a4c8-faab2c30265c None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:09.418652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:09.510809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9f62-9209-4902-a4c8-faab2c30265c None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:09.545179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8588b57-ca19-44c3-8321-fac2298f065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:09.546300 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8588b57-ca19-44c3-8321-fac2298f065b None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:09.546728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8588b57-ca19-44c3-8321-fac2298f065b None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:09.547010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8588b57-ca19-44c3-8321-fac2298f065b None admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:09.547846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8588b57-ca19-44c3-8321-fac2298f065b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:09.548187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8588b57-ca19-44c3-8321-fac2298f065b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:09.549589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8588b57-ca19-44c3-8321-fac2298f065b None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:09.566615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 635/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 22:02:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:09.572700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c27de-275d-4b35-b65f-7ac83377c4ec None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:09.658755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:09.668553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c27de-275d-4b35-b65f-7ac83377c4ec None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:09.701145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc7407-6be3-4443-8867-3477197362b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:09.701807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc7407-6be3-4443-8867-3477197362b7 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:09.702094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc7407-6be3-4443-8867-3477197362b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:09.702370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc7407-6be3-4443-8867-3477197362b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:09.766420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc7407-6be3-4443-8867-3477197362b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:09.767851 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc7407-6be3-4443-8867-3477197362b7 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:09.859760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:09.869833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 647/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 22:02:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 22:02:09.876360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8588b57-ca19-44c3-8321-fac2298f065b None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:09.937579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:09.974624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8588b57-ca19-44c3-8321-fac2298f065b None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:10.006792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52113e-8d9e-4490-8d99-33dfa58e8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:10.007574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52113e-8d9e-4490-8d99-33dfa58e8d22 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:10.007854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52113e-8d9e-4490-8d99-33dfa58e8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:10.008159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52113e-8d9e-4490-8d99-33dfa58e8d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:10.017703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52113e-8d9e-4490-8d99-33dfa58e8d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:10.019162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52113e-8d9e-4490-8d99-33dfa58e8d22 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-4e52113e-8d9e-4490-8d99-33dfa58e8d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 22:02:10.036441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:10.037351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:10.038273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 22:02:10.038273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 22:02:10.038273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 22:02:10.038273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:10.038273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 636/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:10.043234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc7407-6be3-4443-8867-3477197362b7 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:10.140689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc7407-6be3-4443-8867-3477197362b7 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:10.172703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937d12e-cc13-4cc7-b1d5-0a6bff1b5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:10.173354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d12e-cc13-4cc7-b1d5-0a6bff1b5c09 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:10.173641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d12e-cc13-4cc7-b1d5-0a6bff1b5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:10.173920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d12e-cc13-4cc7-b1d5-0a6bff1b5c09 None admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:10.174642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937d12e-cc13-4cc7-b1d5-0a6bff1b5c09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:10.174948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937d12e-cc13-4cc7-b1d5-0a6bff1b5c09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:10.176328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937d12e-cc13-4cc7-b1d5-0a6bff1b5c09 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:10.187664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 648/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 22:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:10.193235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52113e-8d9e-4490-8d99-33dfa58e8d22 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:10.291341 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52113e-8d9e-4490-8d99-33dfa58e8d22 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:10.305762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:10.326484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de493407-517b-4990-b704-6047ff2055b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:10.328255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de493407-517b-4990-b704-6047ff2055b9 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:10.328546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de493407-517b-4990-b704-6047ff2055b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:10.328827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de493407-517b-4990-b704-6047ff2055b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:10.335562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de493407-517b-4990-b704-6047ff2055b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:10.337111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de493407-517b-4990-b704-6047ff2055b9 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application [None req-de493407-517b-4990-b704-6047ff2055b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 22:02:10.351557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:10.352594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:10.353605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 22:02:10.353605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 22:02:10.353605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 22:02:10.353605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 22:02:10.353605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 22:02:10.353605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 22:02:10.353605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 22:02:10.353605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: ERROR keystone.server.flask.application Jul 13 22:02:10.353605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 637/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 22:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:10.358464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937d12e-cc13-4cc7-b1d5-0a6bff1b5c09 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:10.407643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:10.455538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937d12e-cc13-4cc7-b1d5-0a6bff1b5c09 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:10.487889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908acbe-236b-49ca-a597-693f861b092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:10.488564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908acbe-236b-49ca-a597-693f861b092a None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:10.488850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908acbe-236b-49ca-a597-693f861b092a None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:10.489128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908acbe-236b-49ca-a597-693f861b092a None admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:10.489913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908acbe-236b-49ca-a597-693f861b092a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:10.490224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908acbe-236b-49ca-a597-693f861b092a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:10.491642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908acbe-236b-49ca-a597-693f861b092a None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:10.503194 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 649/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 22:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:10.509029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de493407-517b-4990-b704-6047ff2055b9 None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:10.608962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de493407-517b-4990-b704-6047ff2055b9 None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:10.641114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27451bbe-9fe5-40c9-8d28-225c594295f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:10.641757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27451bbe-9fe5-40c9-8d28-225c594295f2 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:10.642044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27451bbe-9fe5-40c9-8d28-225c594295f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:10.642320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27451bbe-9fe5-40c9-8d28-225c594295f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:10.643141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27451bbe-9fe5-40c9-8d28-225c594295f2 None admin] RBAC: Adding query filter params (role.id=27c150d4011b475d8e4ee5726c96a03c, scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad, user.id=1dd6827b3db547b58560a1d4f89e9c14) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:10.643449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27451bbe-9fe5-40c9-8d28-225c594295f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:10.644880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27451bbe-9fe5-40c9-8d28-225c594295f2 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:10.650470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 638/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 22:02:10 2022] GET /identity/v3/role_assignments?user.id=1dd6827b3db547b58560a1d4f89e9c14&scope.project.id=7e14f6463d4f46b0b2a1dba49254cbad&role.id=27c150d4011b475d8e4ee5726c96a03c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:12.710969 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d0b0-dfda-4653-823d-3a55be4e2258 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:12.711531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d0b0-dfda-4653-823d-3a55be4e2258 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:12.711531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d0b0-dfda-4653-823d-3a55be4e2258 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:12.712945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 650/1288] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:02:12.718071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a951-4ac2-459f-9d28-7429510768cb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:12.718460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a951-4ac2-459f-9d28-7429510768cb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:12.718737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a951-4ac2-459f-9d28-7429510768cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:12.735410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b4f2a951-4ac2-459f-9d28-7429510768cb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:02:12.736609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b4f2a951-4ac2-459f-9d28-7429510768cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:02:12.764753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:12.805759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 639/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:02:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:02:12.830607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5d0b0-dfda-4653-823d-3a55be4e2258 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:12.933133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5d0b0-dfda-4653-823d-3a55be4e2258 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:12.943534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:12.966746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30ad2f-e9d7-4f35-80f7-26323ba6a376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:12.968011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30ad2f-e9d7-4f35-80f7-26323ba6a376 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:12.968295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30ad2f-e9d7-4f35-80f7-26323ba6a376 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:12.968736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30ad2f-e9d7-4f35-80f7-26323ba6a376 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:12.969383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30ad2f-e9d7-4f35-80f7-26323ba6a376 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:12.970733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30ad2f-e9d7-4f35-80f7-26323ba6a376 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-0f30ad2f-e9d7-4f35-80f7-26323ba6a376 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:12.982322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:12.983583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:12.984709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 651/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 22:02:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:12.989877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2a951-4ac2-459f-9d28-7429510768cb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:13.083959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2a951-4ac2-459f-9d28-7429510768cb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:13.115918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c068d2c-0b9b-4460-b879-fbe96715b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:13.116584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c068d2c-0b9b-4460-b879-fbe96715b594 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:13.116867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c068d2c-0b9b-4460-b879-fbe96715b594 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:13.117144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c068d2c-0b9b-4460-b879-fbe96715b594 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:13.117846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c068d2c-0b9b-4460-b879-fbe96715b594 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:13.118152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c068d2c-0b9b-4460-b879-fbe96715b594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:13.119494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c068d2c-0b9b-4460-b879-fbe96715b594 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:13.125044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 640/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 13 22:02:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:13.130710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30ad2f-e9d7-4f35-80f7-26323ba6a376 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:13.226110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30ad2f-e9d7-4f35-80f7-26323ba6a376 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:13.258039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b84a5-3bf8-4ba9-9077-10c1312c1e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:13.258679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b84a5-3bf8-4ba9-9077-10c1312c1e27 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:13.258965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b84a5-3bf8-4ba9-9077-10c1312c1e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:13.259248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b84a5-3bf8-4ba9-9077-10c1312c1e27 None admin] PATH_INFO: `/v3/services` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:13.259970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b84a5-3bf8-4ba9-9077-10c1312c1e27 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:13.260282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b84a5-3bf8-4ba9-9077-10c1312c1e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:13.261643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b84a5-3bf8-4ba9-9077-10c1312c1e27 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:13.266248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 652/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 13 22:02:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:15.289104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467e46-046b-4078-8127-662cadfb5f4a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:15.289663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467e46-046b-4078-8127-662cadfb5f4a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:15.289663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467e46-046b-4078-8127-662cadfb5f4a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:15.291029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 641/1293] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:02:15.296680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3858e-c5fc-4aa4-a0f3-d2948ba060e7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:15.297097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3858e-c5fc-4aa4-a0f3-d2948ba060e7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:15.297284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3858e-c5fc-4aa4-a0f3-d2948ba060e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:15.313646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-48e3858e-c5fc-4aa4-a0f3-d2948ba060e7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:02:15.314855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-48e3858e-c5fc-4aa4-a0f3-d2948ba060e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:02:15.344297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:15.382150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 653/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:02:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:02:15.405883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6467e46-046b-4078-8127-662cadfb5f4a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:15.435998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:15.504847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6467e46-046b-4078-8127-662cadfb5f4a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:15.537435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9977813-deb1-4b74-8621-22e3c7336c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:15.538084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9977813-deb1-4b74-8621-22e3c7336c7f None admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:15.538366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9977813-deb1-4b74-8621-22e3c7336c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:15.538641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9977813-deb1-4b74-8621-22e3c7336c7f None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:15.539362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9977813-deb1-4b74-8621-22e3c7336c7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:15.540732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9977813-deb1-4b74-8621-22e3c7336c7f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:15.556238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 642/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 22:02:15 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:02:17.587376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03375e5-3aff-4f90-ba5c-c911d25a95fd None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:17.587942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03375e5-3aff-4f90-ba5c-c911d25a95fd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:17.587942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03375e5-3aff-4f90-ba5c-c911d25a95fd None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:17.589337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 654/1296] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:02:17.594964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879709cb-ae82-4456-8584-c407c424499e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:17.595367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879709cb-ae82-4456-8584-c407c424499e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:17.595519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879709cb-ae82-4456-8584-c407c424499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:17.612378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-879709cb-ae82-4456-8584-c407c424499e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:02:17.613549 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-879709cb-ae82-4456-8584-c407c424499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:02:17.682212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 643/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:02:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:02:17.705052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03375e5-3aff-4f90-ba5c-c911d25a95fd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:17.810617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03375e5-3aff-4f90-ba5c-c911d25a95fd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:17.855915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0f848-bd61-4b44-95f8-432575790570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:17.856652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0f848-bd61-4b44-95f8-432575790570 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:17.856943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0f848-bd61-4b44-95f8-432575790570 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:17.857227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0f848-bd61-4b44-95f8-432575790570 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:17.857880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0f848-bd61-4b44-95f8-432575790570 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:17.859781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0f848-bd61-4b44-95f8-432575790570 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-c2c0f848-bd61-4b44-95f8-432575790570 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:17.871461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:17.872479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:17.873354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 655/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 22:02:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:17.879205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879709cb-ae82-4456-8584-c407c424499e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:17.897402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:17.976711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879709cb-ae82-4456-8584-c407c424499e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:18.008680 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc7e7b-a638-429b-a5ea-e7b1e83e6d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:18.009336 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7e7b-a638-429b-a5ea-e7b1e83e6d6f None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:18.009621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7e7b-a638-429b-a5ea-e7b1e83e6d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:18.009898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7e7b-a638-429b-a5ea-e7b1e83e6d6f None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:18.010606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc7e7b-a638-429b-a5ea-e7b1e83e6d6f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:18.010916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc7e7b-a638-429b-a5ea-e7b1e83e6d6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:18.012292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc7e7b-a638-429b-a5ea-e7b1e83e6d6f None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:18.017806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 644/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 13 22:02:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:18.023650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0f848-bd61-4b44-95f8-432575790570 None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:18.054466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:18.120587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0f848-bd61-4b44-95f8-432575790570 None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:18.152880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31423c-b5f7-40a8-b621-725bef839e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:18.153524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31423c-b5f7-40a8-b621-725bef839e81 None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:18.153812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31423c-b5f7-40a8-b621-725bef839e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:18.154092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31423c-b5f7-40a8-b621-725bef839e81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:18.154877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31423c-b5f7-40a8-b621-725bef839e81 None admin] RBAC: Adding query filter params (interface=public, service_id=82319af302364b5e834989df39e20c06, region_id=RegionOne) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:18.155741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31423c-b5f7-40a8-b621-725bef839e81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:18.157128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31423c-b5f7-40a8-b621-725bef839e81 None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:18.162020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 656/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 22:02:18 2022] GET /identity/v3/endpoints?service_id=82319af302364b5e834989df39e20c06&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:18.167731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc7e7b-a638-429b-a5ea-e7b1e83e6d6f None admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:18.245652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:18.263591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc7e7b-a638-429b-a5ea-e7b1e83e6d6f None admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:18.296255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b949b-ebe9-49a4-8a77-a8c49f1770d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:18.296903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b949b-ebe9-49a4-8a77-a8c49f1770d4 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:18.297188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b949b-ebe9-49a4-8a77-a8c49f1770d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:18.297468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b949b-ebe9-49a4-8a77-a8c49f1770d4 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:18.298142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b949b-ebe9-49a4-8a77-a8c49f1770d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:18.299505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b949b-ebe9-49a4-8a77-a8c49f1770d4 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:18.306206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 645/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 22:02:18 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:02:20.303116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9950698-2e75-4579-b790-d1c97be33e7f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:20.303658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9950698-2e75-4579-b790-d1c97be33e7f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:20.303658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9950698-2e75-4579-b790-d1c97be33e7f None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:20.305068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 657/1302] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:02:20.310356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2408-2090-402c-825a-7b9f99cd3b01 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:20.310773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2408-2090-402c-825a-7b9f99cd3b01 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:20.310924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2408-2090-402c-825a-7b9f99cd3b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:20.327982 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-daaa2408-2090-402c-825a-7b9f99cd3b01 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:02:20.329163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-daaa2408-2090-402c-825a-7b9f99cd3b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:02:20.392719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 646/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:02:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 22:02:20.415647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9950698-2e75-4579-b790-d1c97be33e7f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:20.507161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:20.513952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9950698-2e75-4579-b790-d1c97be33e7f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:20.546317 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec1aca-ecd8-4037-9199-b16d984a10fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:20.547057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec1aca-ecd8-4037-9199-b16d984a10fc None admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:20.547342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec1aca-ecd8-4037-9199-b16d984a10fc None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:20.547619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec1aca-ecd8-4037-9199-b16d984a10fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:20.548292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec1aca-ecd8-4037-9199-b16d984a10fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:20.549634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec1aca-ecd8-4037-9199-b16d984a10fc None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application [None req-75ec1aca-ecd8-4037-9199-b16d984a10fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 22:02:20.561065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 22:02:20.563235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application with Lock( Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self._enter() Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application return self.creator() Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application created_value = creator( Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: ERROR keystone.server.flask.application Jul 13 22:02:20.564501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 658/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 22:02:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 22:02:20.568792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2408-2090-402c-825a-7b9f99cd3b01 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:20.643657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:20.665475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2408-2090-402c-825a-7b9f99cd3b01 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:20.697800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54109a2c-54dd-4102-8e5b-ab0da3d668a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:20.698457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109a2c-54dd-4102-8e5b-ab0da3d668a3 None admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:20.698745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109a2c-54dd-4102-8e5b-ab0da3d668a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:20.699033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109a2c-54dd-4102-8e5b-ab0da3d668a3 None admin] PATH_INFO: `/v3/services` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:20.699736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54109a2c-54dd-4102-8e5b-ab0da3d668a3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:02:20.700072 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54109a2c-54dd-4102-8e5b-ab0da3d668a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:20.701423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54109a2c-54dd-4102-8e5b-ab0da3d668a3 None admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:20.707468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 647/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 13 22:02:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:02:20.713494 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec1aca-ecd8-4037-9199-b16d984a10fc None admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:02:20.812285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec1aca-ecd8-4037-9199-b16d984a10fc None admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:02:20.844450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7f92d-ed4a-476f-b628-c70760c6a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:02:20.845086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7f92d-ed4a-476f-b628-c70760c6a0dd None admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:02:20.845371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7f92d-ed4a-476f-b628-c70760c6a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:02:20.845650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7f92d-ed4a-476f-b628-c70760c6a0dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:02:20.846392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7f92d-ed4a-476f-b628-c70760c6a0dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:02:20.847744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7f92d-ed4a-476f-b628-c70760c6a0dd None admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:02:20.867070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 659/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 22:02:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:02:30.705322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=30 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:02:30.861979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:23.551765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad9ab-ed09-4ded-902c-a2e8f224c696 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:23.552350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad9ab-ed09-4ded-902c-a2e8f224c696 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:23.552350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad9ab-ed09-4ded-902c-a2e8f224c696 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:23.557504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 648/1307] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:23.559089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f8f9e-5c9e-4959-85d1-89180db06765 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:23.559554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f8f9e-5c9e-4959-85d1-89180db06765 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:23.559640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f8f9e-5c9e-4959-85d1-89180db06765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:23.637672 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c38f8f9e-5c9e-4959-85d1-89180db06765 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:23.638828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c38f8f9e-5c9e-4959-85d1-89180db06765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:23.867607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 660/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:03:23.922943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11f92f-0305-475e-96ce-4d75d65f6be8 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:23.923233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11f92f-0305-475e-96ce-4d75d65f6be8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:23.923724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11f92f-0305-475e-96ce-4d75d65f6be8 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:23.925741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 649/1309] 10.222.0.17 () {54 vars in 964 bytes} [Wed Jul 13 22:03:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:23.933225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355b2c3-51ef-4be2-8747-ccff73834002 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:23.933536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355b2c3-51ef-4be2-8747-ccff73834002 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:23.933818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355b2c3-51ef-4be2-8747-ccff73834002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:24.026865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3355b2c3-51ef-4be2-8747-ccff73834002 None None] MFA Rules not processed for user `fb227a145fdd44319f5ccbe762409ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:24.028455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3355b2c3-51ef-4be2-8747-ccff73834002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:24.051034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:24.116352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 661/1310] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Jul 13 22:03:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:24.125571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11f92f-0305-475e-96ce-4d75d65f6be8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:24.127550 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6c11f92f-0305-475e-96ce-4d75d65f6be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:24.248543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11f92f-0305-475e-96ce-4d75d65f6be8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:24.326911 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e904-5a21-47b2-8167-cdbdac88ab8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:24.327783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e904-5a21-47b2-8167-cdbdac88ab8d service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:24.328208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e904-5a21-47b2-8167-cdbdac88ab8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:24.328654 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e904-5a21-47b2-8167-cdbdac88ab8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:24.330576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bc92e904-5a21-47b2-8167-cdbdac88ab8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:24.388350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:24.448144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92e904-5a21-47b2-8167-cdbdac88ab8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:24.449732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92e904-5a21-47b2-8167-cdbdac88ab8d service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:24.472318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 650/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:26.828386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10f63a-8d53-4090-8cc5-7f6adb36fddb None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:26.828897 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10f63a-8d53-4090-8cc5-7f6adb36fddb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:26.829117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10f63a-8d53-4090-8cc5-7f6adb36fddb None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:26.830763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 662/1312] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:26.836267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291670d-7dfe-4a6b-8c98-cc793036f122 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:26.836732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291670d-7dfe-4a6b-8c98-cc793036f122 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:26.836823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291670d-7dfe-4a6b-8c98-cc793036f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:26.926103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1291670d-7dfe-4a6b-8c98-cc793036f122 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:26.927344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1291670d-7dfe-4a6b-8c98-cc793036f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:27.070809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 651/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:27.125842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3667f-e5d0-4523-b3fa-4bd92bb05658 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:27.126232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3667f-e5d0-4523-b3fa-4bd92bb05658 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:27.126518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3667f-e5d0-4523-b3fa-4bd92bb05658 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:27.127993 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 663/1314] 10.222.0.17 () {54 vars in 964 bytes} [Wed Jul 13 22:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:27.134729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753e473-5d1c-4379-ba9a-b2200afed9ac None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:27.135026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753e473-5d1c-4379-ba9a-b2200afed9ac None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:27.135310 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753e473-5d1c-4379-ba9a-b2200afed9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:27.149275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:27.225793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e753e473-5d1c-4379-ba9a-b2200afed9ac None None] MFA Rules not processed for user `fb227a145fdd44319f5ccbe762409ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:27.227057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e753e473-5d1c-4379-ba9a-b2200afed9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:27.309914 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 652/1315] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Jul 13 22:03:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:27.319299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3667f-e5d0-4523-b3fa-4bd92bb05658 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:27.320863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cbd3667f-e5d0-4523-b3fa-4bd92bb05658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:27.436222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3667f-e5d0-4523-b3fa-4bd92bb05658 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:27.512770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:27.516381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d8071-911e-4519-8295-8243dffec1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:27.517405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d8071-911e-4519-8295-8243dffec1bc service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:27.517893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d8071-911e-4519-8295-8243dffec1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:27.518459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d8071-911e-4519-8295-8243dffec1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:27.520523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-002d8071-911e-4519-8295-8243dffec1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:27.633656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d8071-911e-4519-8295-8243dffec1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:27.634997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d8071-911e-4519-8295-8243dffec1bc service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:27.654776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 664/1316] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:30.222475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae4ff-78fe-46ed-bce2-2b2ee385d2e6 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:30.223059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae4ff-78fe-46ed-bce2-2b2ee385d2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:30.223059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae4ff-78fe-46ed-bce2-2b2ee385d2e6 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:30.224447 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 653/1317] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:30.229588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2323a-f043-4814-8166-73e60c263cf2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:30.229998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2323a-f043-4814-8166-73e60c263cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:30.230208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2323a-f043-4814-8166-73e60c263cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:30.293576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-34c2323a-f043-4814-8166-73e60c263cf2 None None] MFA Rules not processed for user `70ffe2ec3c4e406796db401ddf73f909`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:30.294778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-34c2323a-f043-4814-8166-73e60c263cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:30.345076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:30.388758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 665/1318] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:30.427506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae4ff-78fe-46ed-bce2-2b2ee385d2e6 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:30.429087 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ddeae4ff-78fe-46ed-bce2-2b2ee385d2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:30.529042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae4ff-78fe-46ed-bce2-2b2ee385d2e6 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:30.532493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:30.602633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca6c8a-0941-457e-9bd0-82708774c87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:30.603284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6c8a-0941-457e-9bd0-82708774c87b service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:30.603575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6c8a-0941-457e-9bd0-82708774c87b service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:30.603860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6c8a-0941-457e-9bd0-82708774c87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:30.605543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7eca6c8a-0941-457e-9bd0-82708774c87b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:30.711746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca6c8a-0941-457e-9bd0-82708774c87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:30.713129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca6c8a-0941-457e-9bd0-82708774c87b service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:30.731963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 654/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:33.452928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3f4e5-6e61-4275-a627-a0c01bd45f49 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:33.453400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3f4e5-6e61-4275-a627-a0c01bd45f49 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:33.453511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3f4e5-6e61-4275-a627-a0c01bd45f49 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:33.454911 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 666/1320] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:33.459987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055b86e-928d-4342-a2d4-c73424a61a12 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:33.460362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055b86e-928d-4342-a2d4-c73424a61a12 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:33.460560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055b86e-928d-4342-a2d4-c73424a61a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:33.499873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:33.524860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2055b86e-928d-4342-a2d4-c73424a61a12 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:33.526082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2055b86e-928d-4342-a2d4-c73424a61a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:33.621208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 655/1321] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:33.660174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3f4e5-6e61-4275-a627-a0c01bd45f49 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:33.661654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e1f3f4e5-6e61-4275-a627-a0c01bd45f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:33.764111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3f4e5-6e61-4275-a627-a0c01bd45f49 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:33.837618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc27fb-18a6-43d4-a487-f111cb81626d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:33.838259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc27fb-18a6-43d4-a487-f111cb81626d service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:33.838542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc27fb-18a6-43d4-a487-f111cb81626d service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:33.838816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc27fb-18a6-43d4-a487-f111cb81626d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:33.840468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-34cc27fb-18a6-43d4-a487-f111cb81626d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:33.848116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:33.949702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc27fb-18a6-43d4-a487-f111cb81626d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:33.951051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc27fb-18a6-43d4-a487-f111cb81626d service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:33.971715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 667/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:36.759072 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8257-035d-4716-b946-d5767e3916d3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:36.759591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8257-035d-4716-b946-d5767e3916d3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:36.759673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8257-035d-4716-b946-d5767e3916d3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:36.761066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 656/1323] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:36.766737 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7979e-7b24-49f6-936e-f5c14e7d1357 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:36.767137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7979e-7b24-49f6-936e-f5c14e7d1357 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:36.767405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7979e-7b24-49f6-936e-f5c14e7d1357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:36.835277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-36e7979e-7b24-49f6-936e-f5c14e7d1357 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:36.836695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-36e7979e-7b24-49f6-936e-f5c14e7d1357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:36.895790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:36.940562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 668/1324] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:36.977090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c8257-035d-4716-b946-d5767e3916d3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:36.978686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-553c8257-035d-4716-b946-d5767e3916d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:37.089231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c8257-035d-4716-b946-d5767e3916d3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:37.102422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:37.168861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deab453-00ae-41d7-88f7-aefde7189f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:37.169516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deab453-00ae-41d7-88f7-aefde7189f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:37.169806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deab453-00ae-41d7-88f7-aefde7189f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:37.170083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deab453-00ae-41d7-88f7-aefde7189f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:37.171870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5deab453-00ae-41d7-88f7-aefde7189f06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:37.279582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deab453-00ae-41d7-88f7-aefde7189f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:37.281136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deab453-00ae-41d7-88f7-aefde7189f06 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:37.299719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 657/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:39.414199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528069-0658-4f50-b02d-dde4d282c1e0 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:39.414564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528069-0658-4f50-b02d-dde4d282c1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:39.414745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528069-0658-4f50-b02d-dde4d282c1e0 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:39.416158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 669/1326] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:39.421367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7ef7d-c9ab-44f5-97b0-56297f082b72 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:39.422045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7ef7d-c9ab-44f5-97b0-56297f082b72 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:39.422045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7ef7d-c9ab-44f5-97b0-56297f082b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:39.469681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:39.488486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9ae7ef7d-c9ab-44f5-97b0-56297f082b72 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:39.490648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9ae7ef7d-c9ab-44f5-97b0-56297f082b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:39.586205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 658/1327] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:39.622459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32528069-0658-4f50-b02d-dde4d282c1e0 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:39.624039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-32528069-0658-4f50-b02d-dde4d282c1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:39.729522 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32528069-0658-4f50-b02d-dde4d282c1e0 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:39.804372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383dbbf-fc53-4d7c-9a54-1734c8412e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:39.805027 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383dbbf-fc53-4d7c-9a54-1734c8412e3f service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:39.805308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383dbbf-fc53-4d7c-9a54-1734c8412e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:39.805583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383dbbf-fc53-4d7c-9a54-1734c8412e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:39.807291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8383dbbf-fc53-4d7c-9a54-1734c8412e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:39.826694 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:39.922873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383dbbf-fc53-4d7c-9a54-1734c8412e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:39.924365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383dbbf-fc53-4d7c-9a54-1734c8412e3f service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:39.943295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 670/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:42.043956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bc068-a4ec-47b4-bdfd-b9204fb827f8 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:42.044507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bc068-a4ec-47b4-bdfd-b9204fb827f8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:42.044507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bc068-a4ec-47b4-bdfd-b9204fb827f8 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:42.045911 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 659/1329] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:42.051703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f45a-d602-4743-a5b9-f6b3679969b6 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:42.052161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f45a-d602-4743-a5b9-f6b3679969b6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:42.052304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f45a-d602-4743-a5b9-f6b3679969b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:42.121489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2910f45a-d602-4743-a5b9-f6b3679969b6 None None] MFA Rules not processed for user `70ffe2ec3c4e406796db401ddf73f909`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:42.122752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2910f45a-d602-4743-a5b9-f6b3679969b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:42.189987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:42.225039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 671/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:42.263228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bc068-a4ec-47b4-bdfd-b9204fb827f8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:42.264811 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b24bc068-a4ec-47b4-bdfd-b9204fb827f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:42.375450 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bc068-a4ec-47b4-bdfd-b9204fb827f8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:42.394877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:42.449755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cbec4-9fa5-48f8-ab37-9ab131d2b092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:42.449973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cbec4-9fa5-48f8-ab37-9ab131d2b092 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:42.450202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cbec4-9fa5-48f8-ab37-9ab131d2b092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:42.450480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cbec4-9fa5-48f8-ab37-9ab131d2b092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:42.452307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-199cbec4-9fa5-48f8-ab37-9ab131d2b092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:42.561428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cbec4-9fa5-48f8-ab37-9ab131d2b092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:42.563111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cbec4-9fa5-48f8-ab37-9ab131d2b092 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:42.582248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 660/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:03:44.966119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0838b-40eb-408b-9ecd-4eaf5760be2d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:44.966723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0838b-40eb-408b-9ecd-4eaf5760be2d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:44.966723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0838b-40eb-408b-9ecd-4eaf5760be2d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:44.968075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 672/1332] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:44.974629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff887-0f04-429e-962f-ea35ffd3cc2a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:44.975101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff887-0f04-429e-962f-ea35ffd3cc2a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:44.975204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff887-0f04-429e-962f-ea35ffd3cc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:45.043851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:45.048153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0c2ff887-0f04-429e-962f-ea35ffd3cc2a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:45.049652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0c2ff887-0f04-429e-962f-ea35ffd3cc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:45.164569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 661/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:45.209084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0838b-40eb-408b-9ecd-4eaf5760be2d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:45.210656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d8a0838b-40eb-408b-9ecd-4eaf5760be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:45.317866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0838b-40eb-408b-9ecd-4eaf5760be2d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:45.394731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca20119-7028-4c52-ad93-8b851bf7c017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:45.395379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20119-7028-4c52-ad93-8b851bf7c017 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:45.395661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20119-7028-4c52-ad93-8b851bf7c017 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:45.395955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20119-7028-4c52-ad93-8b851bf7c017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:45.397621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1ca20119-7028-4c52-ad93-8b851bf7c017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:45.427434 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:45.524861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca20119-7028-4c52-ad93-8b851bf7c017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:45.526367 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca20119-7028-4c52-ad93-8b851bf7c017 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:45.548334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 673/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:47.636994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c51b1a-1d4f-4ef5-af4c-0313b7db2f9e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:47.637549 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c51b1a-1d4f-4ef5-af4c-0313b7db2f9e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:47.637644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c51b1a-1d4f-4ef5-af4c-0313b7db2f9e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:47.638975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 662/1335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:47.644348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b52abb-57ac-4f91-8dc5-e49a28847746 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:47.644771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b52abb-57ac-4f91-8dc5-e49a28847746 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:47.644939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b52abb-57ac-4f91-8dc5-e49a28847746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:47.709068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-51b52abb-57ac-4f91-8dc5-e49a28847746 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:47.710191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-51b52abb-57ac-4f91-8dc5-e49a28847746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:47.783606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:47.806259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 674/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:47.849405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c51b1a-1d4f-4ef5-af4c-0313b7db2f9e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:47.850946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-52c51b1a-1d4f-4ef5-af4c-0313b7db2f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:47.950769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c51b1a-1d4f-4ef5-af4c-0313b7db2f9e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:47.979122 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:48.023026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84641a0f-b532-40b5-b8a2-03c3002d056b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:48.023670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84641a0f-b532-40b5-b8a2-03c3002d056b service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:48.023976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84641a0f-b532-40b5-b8a2-03c3002d056b service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:48.024256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84641a0f-b532-40b5-b8a2-03c3002d056b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:48.025884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-84641a0f-b532-40b5-b8a2-03c3002d056b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:48.133737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84641a0f-b532-40b5-b8a2-03c3002d056b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:48.135183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84641a0f-b532-40b5-b8a2-03c3002d056b service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:48.153538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 663/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:50.590726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92793-3e40-4939-8d26-ad16cc29cbf5 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:50.591278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92793-3e40-4939-8d26-ad16cc29cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:50.591278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92793-3e40-4939-8d26-ad16cc29cbf5 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:50.592706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 675/1338] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:50.598282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4ff39-c405-4584-bfc7-24e31976be24 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:50.598667 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4ff39-c405-4584-bfc7-24e31976be24 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:50.598852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4ff39-c405-4584-bfc7-24e31976be24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:50.664515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e1c4ff39-c405-4584-bfc7-24e31976be24 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:50.665741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e1c4ff39-c405-4584-bfc7-24e31976be24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:50.673962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:50.762528 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 664/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:50.799768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92793-3e40-4939-8d26-ad16cc29cbf5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:50.801544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d3d92793-3e40-4939-8d26-ad16cc29cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:50.905505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92793-3e40-4939-8d26-ad16cc29cbf5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:50.977194 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f23aca-6c0a-4fdf-8b2f-5605dc50d0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:50.977920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f23aca-6c0a-4fdf-8b2f-5605dc50d0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:50.978219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f23aca-6c0a-4fdf-8b2f-5605dc50d0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:50.978497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f23aca-6c0a-4fdf-8b2f-5605dc50d0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:50.980183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b0f23aca-6c0a-4fdf-8b2f-5605dc50d0c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:51.015574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:51.089255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f23aca-6c0a-4fdf-8b2f-5605dc50d0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:51.090692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f23aca-6c0a-4fdf-8b2f-5605dc50d0c7 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:51.108774 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 676/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:55.077899 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfbb35-dedd-4dda-a18e-53f79bed645d None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:55.078421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfbb35-dedd-4dda-a18e-53f79bed645d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:55.078421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfbb35-dedd-4dda-a18e-53f79bed645d None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:55.079748 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 665/1341] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:55.085194 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f4bb5-6104-4e01-9e38-b1875343d781 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:55.085605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f4bb5-6104-4e01-9e38-b1875343d781 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:55.085884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f4bb5-6104-4e01-9e38-b1875343d781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:55.153435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-476f4bb5-6104-4e01-9e38-b1875343d781 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:55.154661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-476f4bb5-6104-4e01-9e38-b1875343d781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:55.240174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:55.253167 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 677/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:55.291621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfbb35-dedd-4dda-a18e-53f79bed645d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:55.293192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-56cfbb35-dedd-4dda-a18e-53f79bed645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:55.396849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfbb35-dedd-4dda-a18e-53f79bed645d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:55.435659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:55.474631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37393e-5e09-4aa3-aca1-eac1e218b7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:55.475288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37393e-5e09-4aa3-aca1-eac1e218b7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:55.475572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37393e-5e09-4aa3-aca1-eac1e218b7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:55.475846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37393e-5e09-4aa3-aca1-eac1e218b7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:55.477523 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ab37393e-5e09-4aa3-aca1-eac1e218b7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:55.587978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37393e-5e09-4aa3-aca1-eac1e218b7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:55.589362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37393e-5e09-4aa3-aca1-eac1e218b7f2 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:55.608788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 666/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:03:58.398629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409dbd9-2fa3-4250-89f1-fa7c30ea2db6 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:58.399083 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409dbd9-2fa3-4250-89f1-fa7c30ea2db6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:58.399192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409dbd9-2fa3-4250-89f1-fa7c30ea2db6 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:58.400622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 678/1344] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:03:58.405953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a316d-0516-40c6-88f6-98c7d5cb484c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:58.407002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a316d-0516-40c6-88f6-98c7d5cb484c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:58.407002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a316d-0516-40c6-88f6-98c7d5cb484c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:58.473454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c55a316d-0516-40c6-88f6-98c7d5cb484c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:03:58.474672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c55a316d-0516-40c6-88f6-98c7d5cb484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:58.493115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:58.573588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 667/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:03:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:03:58.610858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409dbd9-2fa3-4250-89f1-fa7c30ea2db6 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:03:58.612453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1409dbd9-2fa3-4250-89f1-fa7c30ea2db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:58.715575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409dbd9-2fa3-4250-89f1-fa7c30ea2db6 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:03:58.790787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6c34a-9658-42b6-8dfe-76a38cecb8da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:03:58.791469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c34a-9658-42b6-8dfe-76a38cecb8da service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:03:58.791768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c34a-9658-42b6-8dfe-76a38cecb8da service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:03:58.792075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c34a-9658-42b6-8dfe-76a38cecb8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:03:58.793764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-31b6c34a-9658-42b6-8dfe-76a38cecb8da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:03:58.838538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:03:58.907965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6c34a-9658-42b6-8dfe-76a38cecb8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:03:58.909542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6c34a-9658-42b6-8dfe-76a38cecb8da service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:03:58.928200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 679/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:03:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:02.911574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956186c9-14fb-4e1d-bdcd-de74065da732 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:02.912141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956186c9-14fb-4e1d-bdcd-de74065da732 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:02.912224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956186c9-14fb-4e1d-bdcd-de74065da732 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:02.913583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 668/1347] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:02.918821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eec4c5-fdf1-4577-944b-cd52cba7aceb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:02.919236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eec4c5-fdf1-4577-944b-cd52cba7aceb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:02.919412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eec4c5-fdf1-4577-944b-cd52cba7aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:02.985317 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-68eec4c5-fdf1-4577-944b-cd52cba7aceb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:02.986549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-68eec4c5-fdf1-4577-944b-cd52cba7aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:03.090802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:03.093452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 680/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:03.133219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956186c9-14fb-4e1d-bdcd-de74065da732 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:03.134781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-956186c9-14fb-4e1d-bdcd-de74065da732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:03.258125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956186c9-14fb-4e1d-bdcd-de74065da732 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:03.309351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:03.339031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46d429-a4c4-4943-8ca0-0746502518f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:03.339695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46d429-a4c4-4943-8ca0-0746502518f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:03.340007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46d429-a4c4-4943-8ca0-0746502518f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:03.340286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46d429-a4c4-4943-8ca0-0746502518f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:03.341978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6f46d429-a4c4-4943-8ca0-0746502518f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:03.462963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46d429-a4c4-4943-8ca0-0746502518f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:03.464442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46d429-a4c4-4943-8ca0-0746502518f6 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:03.489690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 669/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:08.431979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05f104-7428-4adb-ba52-f6a17b4e9cc2 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:08.431979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05f104-7428-4adb-ba52-f6a17b4e9cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:08.431979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05f104-7428-4adb-ba52-f6a17b4e9cc2 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:08.432605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 681/1350] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:08.439626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773c740-39c7-44e5-a028-0fb13443a1c7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:08.439626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773c740-39c7-44e5-a028-0fb13443a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:08.439626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773c740-39c7-44e5-a028-0fb13443a1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:08.591667 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6773c740-39c7-44e5-a028-0fb13443a1c7 None None] MFA Rules not processed for user `1dd6827b3db547b58560a1d4f89e9c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:08.592882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6773c740-39c7-44e5-a028-0fb13443a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:08.612836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:08.718940 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 670/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:12.808924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c447-c3bc-4c70-86ee-3a0f12a7fd03 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:12.809452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c447-c3bc-4c70-86ee-3a0f12a7fd03 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:12.809764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c447-c3bc-4c70-86ee-3a0f12a7fd03 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:12.811267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 682/1352] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:12.817786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da0e3b-efbf-4def-b384-3e83da1600e9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:12.818276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da0e3b-efbf-4def-b384-3e83da1600e9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:12.818608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da0e3b-efbf-4def-b384-3e83da1600e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:12.903184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a5da0e3b-efbf-4def-b384-3e83da1600e9 None None] MFA Rules not processed for user `1dd6827b3db547b58560a1d4f89e9c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:12.904579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a5da0e3b-efbf-4def-b384-3e83da1600e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:12.978498 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:13.018073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 671/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:04:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:14.308938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806c44a-afd4-4204-bee5-a19495c174ce None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:14.309518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806c44a-afd4-4204-bee5-a19495c174ce None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:14.309611 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806c44a-afd4-4204-bee5-a19495c174ce None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:14.311054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 683/1354] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:14.316796 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d8ad0-04b7-4acb-8f7f-f0f91aa53241 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:14.317228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d8ad0-04b7-4acb-8f7f-f0f91aa53241 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:14.317359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d8ad0-04b7-4acb-8f7f-f0f91aa53241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:14.392199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d57d8ad0-04b7-4acb-8f7f-f0f91aa53241 None None] MFA Rules not processed for user `1dd6827b3db547b58560a1d4f89e9c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:14.393305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d57d8ad0-04b7-4acb-8f7f-f0f91aa53241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:14.500719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 672/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:04:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:04:18.112218 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b386071-1017-44f4-af1c-47b27baf9f9a None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:18.113066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b386071-1017-44f4-af1c-47b27baf9f9a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:18.113558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b386071-1017-44f4-af1c-47b27baf9f9a None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:18.115493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 684/1356] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:18.121217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cf937-201b-4caf-9e02-da25e0dfd8db None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:18.121695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cf937-201b-4caf-9e02-da25e0dfd8db None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:18.121790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cf937-201b-4caf-9e02-da25e0dfd8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:18.173325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:18.202166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3b5cf937-201b-4caf-9e02-da25e0dfd8db None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:18.204230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3b5cf937-201b-4caf-9e02-da25e0dfd8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:18.311224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 673/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:18.362256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c28f7-7c6d-45c2-a6ca-7cfdbd7c93ba None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:18.362957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c28f7-7c6d-45c2-a6ca-7cfdbd7c93ba None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:18.363474 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c28f7-7c6d-45c2-a6ca-7cfdbd7c93ba None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:18.365386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 685/1358] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 13 22:04:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:18.377244 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76b827-d6c5-4374-aaed-1da8d357e73c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:18.377747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76b827-d6c5-4374-aaed-1da8d357e73c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:18.378176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76b827-d6c5-4374-aaed-1da8d357e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:18.464140 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8a76b827-d6c5-4374-aaed-1da8d357e73c None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:18.465924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8a76b827-d6c5-4374-aaed-1da8d357e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:18.518365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:18.599770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 674/1359] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 13 22:04:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:18.607131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c28f7-7c6d-45c2-a6ca-7cfdbd7c93ba None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:18.608734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8a7c28f7-7c6d-45c2-a6ca-7cfdbd7c93ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:18.760984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c28f7-7c6d-45c2-a6ca-7cfdbd7c93ba None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:18.843039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:18.885197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b680c86-d685-45ab-8659-b7e4b551e841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:18.885759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b680c86-d685-45ab-8659-b7e4b551e841 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:18.886041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b680c86-d685-45ab-8659-b7e4b551e841 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:18.886316 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b680c86-d685-45ab-8659-b7e4b551e841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:18.887960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2b680c86-d685-45ab-8659-b7e4b551e841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:18.989019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b680c86-d685-45ab-8659-b7e4b551e841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:18.990924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b680c86-d685-45ab-8659-b7e4b551e841 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:19.010810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 686/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:04:21.291280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0393bd-81f6-4d85-b352-721e7566b66b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:21.291767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0393bd-81f6-4d85-b352-721e7566b66b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:21.291845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0393bd-81f6-4d85-b352-721e7566b66b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:21.293417 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 675/1361] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:21.298841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cfe35-2818-4dcc-8cf2-b1d1484cd58a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:21.299393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cfe35-2818-4dcc-8cf2-b1d1484cd58a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:21.299393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cfe35-2818-4dcc-8cf2-b1d1484cd58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:21.367121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fa9cfe35-2818-4dcc-8cf2-b1d1484cd58a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:21.368296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fa9cfe35-2818-4dcc-8cf2-b1d1484cd58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:21.407418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:21.471654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 687/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:21.517255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0393bd-81f6-4d85-b352-721e7566b66b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:21.518892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4f0393bd-81f6-4d85-b352-721e7566b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:21.696309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0393bd-81f6-4d85-b352-721e7566b66b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:21.706880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:21.837335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85145177-1ee7-4fad-984f-48256896f2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:21.837975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85145177-1ee7-4fad-984f-48256896f2d8 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:21.838265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85145177-1ee7-4fad-984f-48256896f2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:21.838538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85145177-1ee7-4fad-984f-48256896f2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:21.840197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-85145177-1ee7-4fad-984f-48256896f2d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:21.934633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85145177-1ee7-4fad-984f-48256896f2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:21.936263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85145177-1ee7-4fad-984f-48256896f2d8 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:21.956064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 676/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:24.322680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569aaed-3795-427f-80fd-150531f6776e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:24.323264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569aaed-3795-427f-80fd-150531f6776e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:24.323599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569aaed-3795-427f-80fd-150531f6776e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:24.325386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 688/1364] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:24.330649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f13664-02f8-4707-b1fa-e94bd6cb3c9d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:24.331072 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f13664-02f8-4707-b1fa-e94bd6cb3c9d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:24.331267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f13664-02f8-4707-b1fa-e94bd6cb3c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:24.347469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:24.407827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-24f13664-02f8-4707-b1fa-e94bd6cb3c9d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:24.409107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-24f13664-02f8-4707-b1fa-e94bd6cb3c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:24.519862 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 677/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:24.568454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd257-8cc7-42a8-a417-536b882729f2 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:24.568986 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd257-8cc7-42a8-a417-536b882729f2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:24.569404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd257-8cc7-42a8-a417-536b882729f2 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:24.571224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 689/1366] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 13 22:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:24.576950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939294f3-d1e6-4655-8fa6-f5e2fa644e00 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:24.577212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939294f3-d1e6-4655-8fa6-f5e2fa644e00 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:24.577465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939294f3-d1e6-4655-8fa6-f5e2fa644e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:24.657793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-939294f3-d1e6-4655-8fa6-f5e2fa644e00 None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:24.659055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-939294f3-d1e6-4655-8fa6-f5e2fa644e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:24.695849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:24.790971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 678/1367] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 13 22:04:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:24.801652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd257-8cc7-42a8-a417-536b882729f2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:24.803195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-77dfd257-8cc7-42a8-a417-536b882729f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:24.978453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd257-8cc7-42a8-a417-536b882729f2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:25.001896 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:25.109819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a94a91-f3d1-4754-a330-6a09694104fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:25.110404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a94a91-f3d1-4754-a330-6a09694104fc service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:25.110976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a94a91-f3d1-4754-a330-6a09694104fc service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:25.111329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a94a91-f3d1-4754-a330-6a09694104fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:25.115476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-71a94a91-f3d1-4754-a330-6a09694104fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:25.216622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a94a91-f3d1-4754-a330-6a09694104fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:25.218256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a94a91-f3d1-4754-a330-6a09694104fc service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:25.237467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 690/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:26.313496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79987cc4-119b-4e23-b69b-a100f6e212b2 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:26.314046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79987cc4-119b-4e23-b69b-a100f6e212b2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:26.314046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79987cc4-119b-4e23-b69b-a100f6e212b2 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:26.315622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 679/1369] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:26.320902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20a19-7c17-42a2-8e47-8ef8eb892003 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:26.321332 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20a19-7c17-42a2-8e47-8ef8eb892003 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:26.321513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20a19-7c17-42a2-8e47-8ef8eb892003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:26.354631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:26.391223 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-edb20a19-7c17-42a2-8e47-8ef8eb892003 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:26.392492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-edb20a19-7c17-42a2-8e47-8ef8eb892003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:26.500476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 691/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:26.852131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9fd3-e3e6-4545-af6d-8189fb6ef76e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:26.852131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9fd3-e3e6-4545-af6d-8189fb6ef76e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:26.852131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9fd3-e3e6-4545-af6d-8189fb6ef76e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:26.852131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 680/1371] 10.222.0.17 () {54 vars in 963 bytes} [Wed Jul 13 22:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:26.856829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b272ea-49af-4553-97cc-e8cee0fbc895 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:26.857200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b272ea-49af-4553-97cc-e8cee0fbc895 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:26.857545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b272ea-49af-4553-97cc-e8cee0fbc895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:26.940453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f9b272ea-49af-4553-97cc-e8cee0fbc895 None None] MFA Rules not processed for user `b6d929086ac74f1bb5f323cca822fbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:26.941670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f9b272ea-49af-4553-97cc-e8cee0fbc895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:26.992585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:27.028240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 692/1372] 10.222.0.17 () {58 vars in 1060 bytes} [Wed Jul 13 22:04:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:27.034243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9fd3-e3e6-4545-af6d-8189fb6ef76e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:27.035767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-afea9fd3-e3e6-4545-af6d-8189fb6ef76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:27.153792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9fd3-e3e6-4545-af6d-8189fb6ef76e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:27.200284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:27.236385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc399a1d-ba9f-4886-99e0-efeabdc49e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:27.237041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc399a1d-ba9f-4886-99e0-efeabdc49e19 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:27.237326 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc399a1d-ba9f-4886-99e0-efeabdc49e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:27.237602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc399a1d-ba9f-4886-99e0-efeabdc49e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:27.239255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bc399a1d-ba9f-4886-99e0-efeabdc49e19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:27.357127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc399a1d-ba9f-4886-99e0-efeabdc49e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:27.358615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc399a1d-ba9f-4886-99e0-efeabdc49e19 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:27.380538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 681/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:04:27.432240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fdb94-8855-4497-bc37-8029c54fc7f7 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:27.432722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fdb94-8855-4497-bc37-8029c54fc7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:27.433110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fdb94-8855-4497-bc37-8029c54fc7f7 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:27.436406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 693/1374] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:27.440436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007cae-5d90-4078-b5d9-185f09a01cd7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:27.440529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007cae-5d90-4078-b5d9-185f09a01cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:27.440807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007cae-5d90-4078-b5d9-185f09a01cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:27.518016 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-22007cae-5d90-4078-b5d9-185f09a01cd7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:27.519370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-22007cae-5d90-4078-b5d9-185f09a01cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:27.542624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:27.628277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 682/1375] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:27.675214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fdb94-8855-4497-bc37-8029c54fc7f7 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:27.676860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-470fdb94-8855-4497-bc37-8029c54fc7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:27.835729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fdb94-8855-4497-bc37-8029c54fc7f7 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:27.887656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:27.950230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28351dd1-0495-4330-b734-3f567576d9ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:27.950879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28351dd1-0495-4330-b734-3f567576d9ab service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:27.951166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28351dd1-0495-4330-b734-3f567576d9ab service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:27.951446 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28351dd1-0495-4330-b734-3f567576d9ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:27.953732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-28351dd1-0495-4330-b734-3f567576d9ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:28.042847 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28351dd1-0495-4330-b734-3f567576d9ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:28.044517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28351dd1-0495-4330-b734-3f567576d9ab service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:28.063804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 694/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:30.146870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389f4d-b18f-4511-b77c-a8bb24881127 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:30.147374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389f4d-b18f-4511-b77c-a8bb24881127 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:30.147374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389f4d-b18f-4511-b77c-a8bb24881127 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:30.148803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 683/1377] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:30.154171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b0c3-f561-42c1-8ad9-c21ebee5fbd9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:30.154586 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b0c3-f561-42c1-8ad9-c21ebee5fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:30.154740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b0c3-f561-42c1-8ad9-c21ebee5fbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:30.227790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a128b0c3-f561-42c1-8ad9-c21ebee5fbd9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:30.229177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a128b0c3-f561-42c1-8ad9-c21ebee5fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:30.236774 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:30.337843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 695/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:30.381283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389f4d-b18f-4511-b77c-a8bb24881127 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:30.382816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-66389f4d-b18f-4511-b77c-a8bb24881127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:30.539001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389f4d-b18f-4511-b77c-a8bb24881127 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:30.542778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:30.653905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f5c60-4437-4927-8064-79911e5666f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:30.661906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5c60-4437-4927-8064-79911e5666f8 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:30.661906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5c60-4437-4927-8064-79911e5666f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:30.661906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5c60-4437-4927-8064-79911e5666f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:30.661906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d04f5c60-4437-4927-8064-79911e5666f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:30.754290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f5c60-4437-4927-8064-79911e5666f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:30.755947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f5c60-4437-4927-8064-79911e5666f8 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:30.783822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 684/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:32.882388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6f45c-2bd9-447d-9c7d-732922290369 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:32.882936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6f45c-2bd9-447d-9c7d-732922290369 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:32.882936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6f45c-2bd9-447d-9c7d-732922290369 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:32.884431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 696/1380] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:32.889591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199e6e-ee56-48cd-bf15-5d622845f1c5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:32.890555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199e6e-ee56-48cd-bf15-5d622845f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:32.890705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199e6e-ee56-48cd-bf15-5d622845f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:32.900864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:32.959379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a3199e6e-ee56-48cd-bf15-5d622845f1c5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:32.960647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a3199e6e-ee56-48cd-bf15-5d622845f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:33.074243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 685/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:33.121112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6f45c-2bd9-447d-9c7d-732922290369 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:33.122622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-81d6f45c-2bd9-447d-9c7d-732922290369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:33.268763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:33.282147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6f45c-2bd9-447d-9c7d-732922290369 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:33.409328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00158a8e-ab46-4f91-8e13-3824dccbb3ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:33.409981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158a8e-ab46-4f91-8e13-3824dccbb3ae service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:33.410269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158a8e-ab46-4f91-8e13-3824dccbb3ae service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:33.410537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158a8e-ab46-4f91-8e13-3824dccbb3ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:33.412205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-00158a8e-ab46-4f91-8e13-3824dccbb3ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:33.505752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00158a8e-ab46-4f91-8e13-3824dccbb3ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:33.507368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00158a8e-ab46-4f91-8e13-3824dccbb3ae service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:33.518039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:33.527385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 697/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:04:35.795516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5146c-80dd-4c2a-98e3-515acfe2d19e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:35.796086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5146c-80dd-4c2a-98e3-515acfe2d19e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:35.796294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5146c-80dd-4c2a-98e3-515acfe2d19e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:35.798215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 686/1383] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:04:35.803888 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0edc06-4f99-4b19-bb4f-653477317fd4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:35.804338 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0edc06-4f99-4b19-bb4f-653477317fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:35.804509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0edc06-4f99-4b19-bb4f-653477317fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:35.870443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2a0edc06-4f99-4b19-bb4f-653477317fd4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:35.871756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2a0edc06-4f99-4b19-bb4f-653477317fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:35.974683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 698/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:36.018360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5146c-80dd-4c2a-98e3-515acfe2d19e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:36.019852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-10b5146c-80dd-4c2a-98e3-515acfe2d19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:36.120385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:36.185822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5146c-80dd-4c2a-98e3-515acfe2d19e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:36.309028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3efb1-b2e7-4ca6-ab87-172d010ba9bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:36.309713 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3efb1-b2e7-4ca6-ab87-172d010ba9bd service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:36.310014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3efb1-b2e7-4ca6-ab87-172d010ba9bd service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:36.310307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3efb1-b2e7-4ca6-ab87-172d010ba9bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:36.312707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bbc3efb1-b2e7-4ca6-ab87-172d010ba9bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:36.364094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:36.414709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3efb1-b2e7-4ca6-ab87-172d010ba9bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:36.416362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3efb1-b2e7-4ca6-ab87-172d010ba9bd service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:36.434196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 687/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:38.749320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3906bb3-b68b-488a-9ebb-72f014b0f2ee None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:38.750030 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3906bb3-b68b-488a-9ebb-72f014b0f2ee None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:38.750309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3906bb3-b68b-488a-9ebb-72f014b0f2ee None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:38.751846 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 699/1386] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:38.757532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e403c04-7491-4d3e-aec1-eeba51dba1d5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:38.757974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e403c04-7491-4d3e-aec1-eeba51dba1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:38.758088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e403c04-7491-4d3e-aec1-eeba51dba1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:38.827294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3e403c04-7491-4d3e-aec1-eeba51dba1d5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:38.829066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3e403c04-7491-4d3e-aec1-eeba51dba1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:38.941289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 688/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:38.986560 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3906bb3-b68b-488a-9ebb-72f014b0f2ee None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:38.988104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b3906bb3-b68b-488a-9ebb-72f014b0f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:39.065126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:39.139288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3906bb3-b68b-488a-9ebb-72f014b0f2ee None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:39.272824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3c68-64f9-4668-9661-263b95e4500b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:39.273474 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3c68-64f9-4668-9661-263b95e4500b service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:39.273783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3c68-64f9-4668-9661-263b95e4500b service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:39.274059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3c68-64f9-4668-9661-263b95e4500b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:39.275752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cefe3c68-64f9-4668-9661-263b95e4500b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:39.314913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:39.372659 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3c68-64f9-4668-9661-263b95e4500b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:39.375189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3c68-64f9-4668-9661-263b95e4500b service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:39.394277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 700/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:41.467600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3fc24-5ae2-4728-b883-e0c18b20164f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:41.468607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3fc24-5ae2-4728-b883-e0c18b20164f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:41.469290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3fc24-5ae2-4728-b883-e0c18b20164f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:41.470752 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 689/1389] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:41.476155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e7391-2e02-43f9-86f4-b8b3d06519ea None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:41.476564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e7391-2e02-43f9-86f4-b8b3d06519ea None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:41.476722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e7391-2e02-43f9-86f4-b8b3d06519ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:41.540604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-953e7391-2e02-43f9-86f4-b8b3d06519ea None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:41.541801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-953e7391-2e02-43f9-86f4-b8b3d06519ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:41.637270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 701/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:41.681988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3fc24-5ae2-4728-b883-e0c18b20164f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:41.683535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7cc3fc24-5ae2-4728-b883-e0c18b20164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:41.715473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:41.835390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3fc24-5ae2-4728-b883-e0c18b20164f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:41.938296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:42.066018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95d27a-bdbb-433b-925a-2d950214ba1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:42.066665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95d27a-bdbb-433b-925a-2d950214ba1f service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:42.066959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95d27a-bdbb-433b-925a-2d950214ba1f service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:42.067232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95d27a-bdbb-433b-925a-2d950214ba1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:42.068909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7f95d27a-bdbb-433b-925a-2d950214ba1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:42.162641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95d27a-bdbb-433b-925a-2d950214ba1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:42.164262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95d27a-bdbb-433b-925a-2d950214ba1f service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:42.182392 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 690/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:04:42.677487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63e10-144c-429c-8a2c-14c0731dac8e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:42.678028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63e10-144c-429c-8a2c-14c0731dac8e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:42.678028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63e10-144c-429c-8a2c-14c0731dac8e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:42.679503 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 702/1392] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:04:42.684640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81746b-4fdb-48e9-8169-e36f80a1860d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:42.685085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81746b-4fdb-48e9-8169-e36f80a1860d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:42.685182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81746b-4fdb-48e9-8169-e36f80a1860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:42.749051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9e81746b-4fdb-48e9-8169-e36f80a1860d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:42.750249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9e81746b-4fdb-48e9-8169-e36f80a1860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:42.810024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:42.849146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 691/1393] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:42.903514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc70e7-6d97-4114-996a-e97109bfcc31 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:42.903871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc70e7-6d97-4114-996a-e97109bfcc31 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:42.904240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc70e7-6d97-4114-996a-e97109bfcc31 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:42.906305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 703/1394] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jul 13 22:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:42.911614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56bba0-097b-40d1-96d6-eaddf9feb7bb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:42.911956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56bba0-097b-40d1-96d6-eaddf9feb7bb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:42.912270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56bba0-097b-40d1-96d6-eaddf9feb7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:42.986285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6a56bba0-097b-40d1-96d6-eaddf9feb7bb None None] MFA Rules not processed for user `46a7d9cfbbcd4068aa9241ffd694c631`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:42.987485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6a56bba0-097b-40d1-96d6-eaddf9feb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:43.062115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 692/1395] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jul 13 22:04:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:43.069871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc70e7-6d97-4114-996a-e97109bfcc31 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:43.071395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f3fc70e7-6d97-4114-996a-e97109bfcc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:43.084713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:43.180926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc70e7-6d97-4114-996a-e97109bfcc31 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:43.254435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ed55-31db-4bba-8b17-c81738bfcb15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7d9cfbbcd4068aa9241ffd694c631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:43.255005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ed55-31db-4bba-8b17-c81738bfcb15 service glance] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:43.255292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ed55-31db-4bba-8b17-c81738bfcb15 service glance] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:43.255598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ed55-31db-4bba-8b17-c81738bfcb15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:43.257344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-64a5ed55-31db-4bba-8b17-c81738bfcb15 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:43.325740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:43.369657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5ed55-31db-4bba-8b17-c81738bfcb15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:43.371105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5ed55-31db-4bba-8b17-c81738bfcb15 service glance] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:43.390796 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 704/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:44.100053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf04c-5fe5-4dd9-9c7e-22dc7935d40e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:44.100532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf04c-5fe5-4dd9-9c7e-22dc7935d40e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:44.100739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf04c-5fe5-4dd9-9c7e-22dc7935d40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:44.176211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2cfaf04c-5fe5-4dd9-9c7e-22dc7935d40e None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:44.177436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2cfaf04c-5fe5-4dd9-9c7e-22dc7935d40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:44.185707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:44.276742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 693/1397] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:04:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:44.289313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f35cb6-5b09-407b-9b5a-d5878c709d79 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:44.289735 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f35cb6-5b09-407b-9b5a-d5878c709d79 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:44.289885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f35cb6-5b09-407b-9b5a-d5878c709d79 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:44.291278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 705/1398] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:44.297225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036344-8b63-48ec-823f-153dc7497e19 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:44.297529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036344-8b63-48ec-823f-153dc7497e19 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:44.297813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036344-8b63-48ec-823f-153dc7497e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:44.319730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434a68d-04b5-4692-8db0-41456faf1a7e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:44.320059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434a68d-04b5-4692-8db0-41456faf1a7e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:44.320342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434a68d-04b5-4692-8db0-41456faf1a7e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:44.321745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 706/1399] 10.222.0.17 () {54 vars in 942 bytes} [Wed Jul 13 22:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:04:44.328360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bba2d0-1f57-4382-945c-3ecd0989abac None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:44.328748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bba2d0-1f57-4382-945c-3ecd0989abac None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:44.329129 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bba2d0-1f57-4382-945c-3ecd0989abac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:44.364442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5f036344-8b63-48ec-823f-153dc7497e19 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:44.365617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5f036344-8b63-48ec-823f-153dc7497e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:44.404565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d9bba2d0-1f57-4382-945c-3ecd0989abac None None] MFA Rules not processed for user `2695a36b9b38450981588c31c2b9afc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:44.405879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d9bba2d0-1f57-4382-945c-3ecd0989abac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:44.465950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 694/1400] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:44.510309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036344-8b63-48ec-823f-153dc7497e19 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:44.511504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5f036344-8b63-48ec-823f-153dc7497e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:44.514102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:44.523693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 707/1401] 10.222.0.17 () {58 vars in 1039 bytes} [Wed Jul 13 22:04:44 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:04:44.534227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bba2d0-1f57-4382-945c-3ecd0989abac None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:44.538953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:44.545522 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bba2d0-1f57-4382-945c-3ecd0989abac None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:44.628515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036344-8b63-48ec-823f-153dc7497e19 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:44.656765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9328b-d6ab-4d2c-88a2-4f809d59df73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:44.657420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9328b-d6ab-4d2c-88a2-4f809d59df73 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:44.657706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9328b-d6ab-4d2c-88a2-4f809d59df73 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:44.657988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9328b-d6ab-4d2c-88a2-4f809d59df73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:44.659730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-29b9328b-d6ab-4d2c-88a2-4f809d59df73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:44.742191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:44.742687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9328b-d6ab-4d2c-88a2-4f809d59df73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:44.744613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9328b-d6ab-4d2c-88a2-4f809d59df73 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:44.744741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff612e96-4e6b-48d1-a957-571cdc0a3763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:44.745527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff612e96-4e6b-48d1-a957-571cdc0a3763 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:44.746059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff612e96-4e6b-48d1-a957-571cdc0a3763 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:44.746557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff612e96-4e6b-48d1-a957-571cdc0a3763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:44.748509 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ff612e96-4e6b-48d1-a957-571cdc0a3763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:44.753733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 708/1402] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 22:04:44.845111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff612e96-4e6b-48d1-a957-571cdc0a3763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:44.846795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff612e96-4e6b-48d1-a957-571cdc0a3763 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:44.869920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 695/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:04:46.973364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de729-638c-4c70-b4f1-e169137cdb96 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:46.974075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de729-638c-4c70-b4f1-e169137cdb96 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:46.974075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de729-638c-4c70-b4f1-e169137cdb96 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:46.975207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 709/1404] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:04:46.980644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adc192-596a-4973-8241-3f97843e9a2a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:46.981089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adc192-596a-4973-8241-3f97843e9a2a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:46.981198 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adc192-596a-4973-8241-3f97843e9a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:47.066328 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b1adc192-596a-4973-8241-3f97843e9a2a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:47.067969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b1adc192-596a-4973-8241-3f97843e9a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:47.172336 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:47.209526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 696/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:47.262297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de729-638c-4c70-b4f1-e169137cdb96 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:47.263819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-411de729-638c-4c70-b4f1-e169137cdb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:47.315448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:47.468677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de729-638c-4c70-b4f1-e169137cdb96 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:47.615240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:47.627347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9bdd3-adf3-40c9-ad15-211e9189358c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:47.628300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bdd3-adf3-40c9-ad15-211e9189358c service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:47.628587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bdd3-adf3-40c9-ad15-211e9189358c service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:47.628866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bdd3-adf3-40c9-ad15-211e9189358c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:47.630576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c3a9bdd3-adf3-40c9-ad15-211e9189358c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:47.740199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9bdd3-adf3-40c9-ad15-211e9189358c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:47.741868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9bdd3-adf3-40c9-ad15-211e9189358c service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:47.761170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 710/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:04:49.926661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c81618-156c-4d70-a0c6-aa7cfbb6a80f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:49.927248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c81618-156c-4d70-a0c6-aa7cfbb6a80f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:49.927248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c81618-156c-4d70-a0c6-aa7cfbb6a80f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:49.932373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 697/1407] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:04:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:04:49.933750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02433ecc-1f8d-432f-87a6-0efbe79e0fe3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:49.934177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02433ecc-1f8d-432f-87a6-0efbe79e0fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:49.934346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02433ecc-1f8d-432f-87a6-0efbe79e0fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:50.009352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-02433ecc-1f8d-432f-87a6-0efbe79e0fe3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:04:50.009352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-02433ecc-1f8d-432f-87a6-0efbe79e0fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:50.076572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:50.116112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 711/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:04:50.159532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c81618-156c-4d70-a0c6-aa7cfbb6a80f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:04:50.161216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-56c81618-156c-4d70-a0c6-aa7cfbb6a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:50.327890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c81618-156c-4d70-a0c6-aa7cfbb6a80f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:04:50.393116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:04:50.459093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e303b6c-aeb7-4ae3-b7ce-2facaf32908d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:04:50.459692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303b6c-aeb7-4ae3-b7ce-2facaf32908d service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:04:50.460161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303b6c-aeb7-4ae3-b7ce-2facaf32908d service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:04:50.460446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303b6c-aeb7-4ae3-b7ce-2facaf32908d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:04:50.462097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5e303b6c-aeb7-4ae3-b7ce-2facaf32908d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:04:50.563961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e303b6c-aeb7-4ae3-b7ce-2facaf32908d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:04:50.565577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e303b6c-aeb7-4ae3-b7ce-2facaf32908d service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:04:50.586194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 698/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:00.111261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=14 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:00.583781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=73 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:07.526962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fbebf-4316-4062-bba8-fad147c8f959 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:07.527549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fbebf-4316-4062-bba8-fad147c8f959 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:07.527549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fbebf-4316-4062-bba8-fad147c8f959 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:07.528950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 712/1410] 10.222.0.17 () {54 vars in 918 bytes} [Wed Jul 13 22:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:07.534364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7a84-455d-4282-a03b-7293ff44ce65 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:07.534768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7a84-455d-4282-a03b-7293ff44ce65 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:07.534930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7a84-455d-4282-a03b-7293ff44ce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:07.607918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e9cf7a84-455d-4282-a03b-7293ff44ce65 None None] MFA Rules not processed for user `1dd6827b3db547b58560a1d4f89e9c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:07.609743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e9cf7a84-455d-4282-a03b-7293ff44ce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:07.713953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 699/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jul 13 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:07.728823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2099fe-8f07-4d1f-b06a-b872367aefc4 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:07.729115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2099fe-8f07-4d1f-b06a-b872367aefc4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:07.729400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2099fe-8f07-4d1f-b06a-b872367aefc4 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:07.730769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 713/1412] 10.222.0.17 () {54 vars in 918 bytes} [Wed Jul 13 22:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:07.735931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ac0b4-60a3-4849-965f-7f5c2fe2a360 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:07.736227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ac0b4-60a3-4849-965f-7f5c2fe2a360 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:07.736503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ac0b4-60a3-4849-965f-7f5c2fe2a360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:07.805892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:07.808698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b90ac0b4-60a3-4849-965f-7f5c2fe2a360 None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:07.810609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b90ac0b4-60a3-4849-965f-7f5c2fe2a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:07.927115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 700/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jul 13 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:10.420239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720203c-1e7a-4e77-b831-eccdd5bdc115 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:10.420875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720203c-1e7a-4e77-b831-eccdd5bdc115 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:10.420875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720203c-1e7a-4e77-b831-eccdd5bdc115 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:10.422771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:10.427880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80fc69-1144-4e37-a1c1-ef841ea4ab31 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:10.428300 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80fc69-1144-4e37-a1c1-ef841ea4ab31 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:10.428463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80fc69-1144-4e37-a1c1-ef841ea4ab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:10.493220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4f80fc69-1144-4e37-a1c1-ef841ea4ab31 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:10.494717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4f80fc69-1144-4e37-a1c1-ef841ea4ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:10.549237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:10.590269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:10.633446 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720203c-1e7a-4e77-b831-eccdd5bdc115 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:10.635224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5720203c-1e7a-4e77-b831-eccdd5bdc115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:10.776918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720203c-1e7a-4e77-b831-eccdd5bdc115 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:10.850264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:10.890222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec589d97-a124-4ebc-acb5-515d7632a113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:10.890872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589d97-a124-4ebc-acb5-515d7632a113 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:10.891160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589d97-a124-4ebc-acb5-515d7632a113 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:10.891440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589d97-a124-4ebc-acb5-515d7632a113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:10.893136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec589d97-a124-4ebc-acb5-515d7632a113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:10.980590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589d97-a124-4ebc-acb5-515d7632a113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:10.982179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589d97-a124-4ebc-acb5-515d7632a113 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:11.000781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 715/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:11.897159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f221aa8-11cc-4d9c-aa93-e1caa604f109 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:11.897724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f221aa8-11cc-4d9c-aa93-e1caa604f109 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:11.897829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f221aa8-11cc-4d9c-aa93-e1caa604f109 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:11.899181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:11.904103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bdb8f-50c8-485d-b016-6ac7b3464128 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:11.904502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bdb8f-50c8-485d-b016-6ac7b3464128 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:11.904671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bdb8f-50c8-485d-b016-6ac7b3464128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:11.980419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-130bdb8f-50c8-485d-b016-6ac7b3464128 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:11.981625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-130bdb8f-50c8-485d-b016-6ac7b3464128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:12.007771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:12.076524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:12.225700 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f221aa8-11cc-4d9c-aa93-e1caa604f109 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:12.227158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6f221aa8-11cc-4d9c-aa93-e1caa604f109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:12.368427 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f221aa8-11cc-4d9c-aa93-e1caa604f109 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:12.407517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:12.478477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e046e62-9b8f-4d5e-85fc-17d16db451a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:12.479052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e046e62-9b8f-4d5e-85fc-17d16db451a1 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:12.479335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e046e62-9b8f-4d5e-85fc-17d16db451a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:12.479612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e046e62-9b8f-4d5e-85fc-17d16db451a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:12.481273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1e046e62-9b8f-4d5e-85fc-17d16db451a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:12.571243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e046e62-9b8f-4d5e-85fc-17d16db451a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:12.572832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e046e62-9b8f-4d5e-85fc-17d16db451a1 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:12.590551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 703/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:13.486512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08105677-90ad-434d-b05f-cb45b0f63007 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:13.486945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08105677-90ad-434d-b05f-cb45b0f63007 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:13.487064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08105677-90ad-434d-b05f-cb45b0f63007 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:13.488483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:13.493307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483aab8d-ee82-4701-ba68-aea5aef87133 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:13.493705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483aab8d-ee82-4701-ba68-aea5aef87133 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:13.493871 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483aab8d-ee82-4701-ba68-aea5aef87133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:13.545365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:13.567457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-483aab8d-ee82-4701-ba68-aea5aef87133 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:13.568768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-483aab8d-ee82-4701-ba68-aea5aef87133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:13.664670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:13.816870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08105677-90ad-434d-b05f-cb45b0f63007 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:13.818441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-08105677-90ad-434d-b05f-cb45b0f63007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:13.962363 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08105677-90ad-434d-b05f-cb45b0f63007 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:13.974556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:14.075432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105adc79-a59c-4796-9f1c-31aeecde8447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:14.076038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105adc79-a59c-4796-9f1c-31aeecde8447 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:14.076333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105adc79-a59c-4796-9f1c-31aeecde8447 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:14.076614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105adc79-a59c-4796-9f1c-31aeecde8447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:14.078453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-105adc79-a59c-4796-9f1c-31aeecde8447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:14.168990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105adc79-a59c-4796-9f1c-31aeecde8447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:14.171179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105adc79-a59c-4796-9f1c-31aeecde8447 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:14.189598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 718/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:15.056967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2dd23-23a8-40c0-ad7e-e59f5806efac None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:15.057542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2dd23-23a8-40c0-ad7e-e59f5806efac None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:15.057542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2dd23-23a8-40c0-ad7e-e59f5806efac None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:15.058909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:15.063806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f666a-b89f-4e10-bffe-22b2acf5339a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:15.064264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f666a-b89f-4e10-bffe-22b2acf5339a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:15.064393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f666a-b89f-4e10-bffe-22b2acf5339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:15.082971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:15.140409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2a4f666a-b89f-4e10-bffe-22b2acf5339a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:15.141609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2a4f666a-b89f-4e10-bffe-22b2acf5339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:15.238096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:15.395418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2dd23-23a8-40c0-ad7e-e59f5806efac None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:15.396974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e8c2dd23-23a8-40c0-ad7e-e59f5806efac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:15.503648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:15.539244 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2dd23-23a8-40c0-ad7e-e59f5806efac None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:15.657090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6367c64-8730-4fd6-b9ba-1418a7f06449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:15.657668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367c64-8730-4fd6-b9ba-1418a7f06449 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:15.657952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367c64-8730-4fd6-b9ba-1418a7f06449 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:15.658232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367c64-8730-4fd6-b9ba-1418a7f06449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:15.659879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f6367c64-8730-4fd6-b9ba-1418a7f06449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:15.737635 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:15.752018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6367c64-8730-4fd6-b9ba-1418a7f06449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:15.753596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6367c64-8730-4fd6-b9ba-1418a7f06449 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:15.771332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 706/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:16.640568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50bb04-bca5-4dce-b695-110db9bc13a3 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:16.641138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50bb04-bca5-4dce-b695-110db9bc13a3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:16.641138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50bb04-bca5-4dce-b695-110db9bc13a3 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:16.642519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:16.647449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a8aca-87aa-438c-8fc1-5ad60e04dd07 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:16.647830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a8aca-87aa-438c-8fc1-5ad60e04dd07 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:16.648036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a8aca-87aa-438c-8fc1-5ad60e04dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:16.720931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-582a8aca-87aa-438c-8fc1-5ad60e04dd07 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:16.722163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-582a8aca-87aa-438c-8fc1-5ad60e04dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:16.816063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:16.966603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50bb04-bca5-4dce-b695-110db9bc13a3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:16.968805 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8f50bb04-bca5-4dce-b695-110db9bc13a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:17.051250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:17.113647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50bb04-bca5-4dce-b695-110db9bc13a3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:17.229156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3e161-900c-47c4-9f50-bdb228b24522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:17.229753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3e161-900c-47c4-9f50-bdb228b24522 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:17.230041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3e161-900c-47c4-9f50-bdb228b24522 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:17.230320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3e161-900c-47c4-9f50-bdb228b24522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:17.231992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ddf3e161-900c-47c4-9f50-bdb228b24522 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:17.279191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:17.319494 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3e161-900c-47c4-9f50-bdb228b24522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:17.321114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3e161-900c-47c4-9f50-bdb228b24522 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:17.339603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 721/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:18.152891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e985fb8-2e99-4646-925f-3f0ef9b822f0 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:18.153385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e985fb8-2e99-4646-925f-3f0ef9b822f0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:18.153492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e985fb8-2e99-4646-925f-3f0ef9b822f0 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:18.154825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:18.160220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26185195-a2dc-44f6-b186-6367ff9effa8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:18.160648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26185195-a2dc-44f6-b186-6367ff9effa8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:18.160799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26185195-a2dc-44f6-b186-6367ff9effa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:18.238006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-26185195-a2dc-44f6-b186-6367ff9effa8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:18.239239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-26185195-a2dc-44f6-b186-6367ff9effa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:18.335174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:18.485924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e985fb8-2e99-4646-925f-3f0ef9b822f0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:18.487447 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6e985fb8-2e99-4646-925f-3f0ef9b822f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:18.534729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:18.631613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e985fb8-2e99-4646-925f-3f0ef9b822f0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:18.743436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676748b-b440-4ead-a077-f0485ec024f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:18.744049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676748b-b440-4ead-a077-f0485ec024f2 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:18.744341 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676748b-b440-4ead-a077-f0485ec024f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:18.744622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676748b-b440-4ead-a077-f0485ec024f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:18.746312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1676748b-b440-4ead-a077-f0485ec024f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:18.753485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:18.837533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676748b-b440-4ead-a077-f0485ec024f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:18.839383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676748b-b440-4ead-a077-f0485ec024f2 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:18.857964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 709/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:19.664839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac005280-3467-430c-8bb7-d64609dd759b None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:19.665440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac005280-3467-430c-8bb7-d64609dd759b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:19.665440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac005280-3467-430c-8bb7-d64609dd759b None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:19.666788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:19.671841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5037763-54c7-484f-b3d9-fc9e811a6bac None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:19.672327 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5037763-54c7-484f-b3d9-fc9e811a6bac None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:19.672474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5037763-54c7-484f-b3d9-fc9e811a6bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:19.745195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d5037763-54c7-484f-b3d9-fc9e811a6bac None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:19.746401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d5037763-54c7-484f-b3d9-fc9e811a6bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:19.814033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:19.843640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:19.994703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac005280-3467-430c-8bb7-d64609dd759b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:19.996343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ac005280-3467-430c-8bb7-d64609dd759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:20.014130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:20.141403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac005280-3467-430c-8bb7-d64609dd759b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:20.231774 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:20.257204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9834a-3ab3-4633-a47b-184f1b1d5e37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:20.257787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9834a-3ab3-4633-a47b-184f1b1d5e37 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:20.258073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9834a-3ab3-4633-a47b-184f1b1d5e37 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:20.258351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9834a-3ab3-4633-a47b-184f1b1d5e37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:20.260054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d5e9834a-3ab3-4633-a47b-184f1b1d5e37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:20.348528 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9834a-3ab3-4633-a47b-184f1b1d5e37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:20.350127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9834a-3ab3-4633-a47b-184f1b1d5e37 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:20.367878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 724/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:21.183254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e78c-6ddc-4b67-a044-55a54bfd693f None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:21.183806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e78c-6ddc-4b67-a044-55a54bfd693f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:21.183806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e78c-6ddc-4b67-a044-55a54bfd693f None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:21.185285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:21.190395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48d256-e1dd-4f31-bd9c-85e3793e599c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:21.190798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48d256-e1dd-4f31-bd9c-85e3793e599c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:21.190960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48d256-e1dd-4f31-bd9c-85e3793e599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:21.265308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8f48d256-e1dd-4f31-bd9c-85e3793e599c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:21.266524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8f48d256-e1dd-4f31-bd9c-85e3793e599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:21.424071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:21.477796 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:21.629800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e78c-6ddc-4b67-a044-55a54bfd693f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:21.631342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9506e78c-6ddc-4b67-a044-55a54bfd693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:21.773994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e78c-6ddc-4b67-a044-55a54bfd693f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:21.828304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:21.885290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a351701-4d96-43cc-b04f-a2bcd0722b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:21.885951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351701-4d96-43cc-b04f-a2bcd0722b08 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:21.886237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351701-4d96-43cc-b04f-a2bcd0722b08 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:21.886517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351701-4d96-43cc-b04f-a2bcd0722b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:21.888220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3a351701-4d96-43cc-b04f-a2bcd0722b08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:21.976442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a351701-4d96-43cc-b04f-a2bcd0722b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:21.978018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a351701-4d96-43cc-b04f-a2bcd0722b08 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:21.995478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 712/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:22.803340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe625b-2388-4b4a-948a-ff9d91c7650f None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:22.803919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe625b-2388-4b4a-948a-ff9d91c7650f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:22.803919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe625b-2388-4b4a-948a-ff9d91c7650f None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:22.805830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:22.810462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c63908-f120-4fd2-8742-2f3edb4052ab None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:22.810967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c63908-f120-4fd2-8742-2f3edb4052ab None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:22.811695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c63908-f120-4fd2-8742-2f3edb4052ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:22.887691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c9c63908-f120-4fd2-8742-2f3edb4052ab None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:22.888927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c9c63908-f120-4fd2-8742-2f3edb4052ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:22.891765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:22.986092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:23.140953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe625b-2388-4b4a-948a-ff9d91c7650f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:23.142463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-acbe625b-2388-4b4a-948a-ff9d91c7650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:23.285038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe625b-2388-4b4a-948a-ff9d91c7650f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:23.310573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:23.397825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408152a-7b52-4a43-97bc-8439bd41ac8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:23.398384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408152a-7b52-4a43-97bc-8439bd41ac8b service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:23.398674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408152a-7b52-4a43-97bc-8439bd41ac8b service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:23.398957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408152a-7b52-4a43-97bc-8439bd41ac8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:23.400671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e408152a-7b52-4a43-97bc-8439bd41ac8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:23.495125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408152a-7b52-4a43-97bc-8439bd41ac8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:23.496758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408152a-7b52-4a43-97bc-8439bd41ac8b service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:23.515618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 727/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:25.453617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496f5ac-3468-492d-907e-68c9e77abb3b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:25.454260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496f5ac-3468-492d-907e-68c9e77abb3b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:25.454260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496f5ac-3468-492d-907e-68c9e77abb3b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:25.455570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:25.461054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e95ba8-b841-442d-a3fa-fe661e655dc4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:25.461484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e95ba8-b841-442d-a3fa-fe661e655dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:25.461597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e95ba8-b841-442d-a3fa-fe661e655dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:25.505292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:25.530126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-43e95ba8-b841-442d-a3fa-fe661e655dc4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:25.531329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-43e95ba8-b841-442d-a3fa-fe661e655dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:25.625469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:05:25.663765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496f5ac-3468-492d-907e-68c9e77abb3b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:25.665430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2496f5ac-3468-492d-907e-68c9e77abb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:25.770778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496f5ac-3468-492d-907e-68c9e77abb3b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:25.802562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:25.843997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b89e9-706f-4aa8-afc4-e158134af145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:25.844657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b89e9-706f-4aa8-afc4-e158134af145 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:25.844946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b89e9-706f-4aa8-afc4-e158134af145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:25.845229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b89e9-706f-4aa8-afc4-e158134af145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:25.846894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-275b89e9-706f-4aa8-afc4-e158134af145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:25.953275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b89e9-706f-4aa8-afc4-e158134af145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:25.954730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b89e9-706f-4aa8-afc4-e158134af145 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:25.975462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 715/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:28.232537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883658d6-b16d-4622-8c61-9b885fbe195c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:28.233163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883658d6-b16d-4622-8c61-9b885fbe195c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:28.233268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883658d6-b16d-4622-8c61-9b885fbe195c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:28.234760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:28.240425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ed05a-c2e2-43ae-a427-259fde97936e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:28.240823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ed05a-c2e2-43ae-a427-259fde97936e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:28.240990 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ed05a-c2e2-43ae-a427-259fde97936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:28.305129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c47ed05a-c2e2-43ae-a427-259fde97936e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:28.306339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c47ed05a-c2e2-43ae-a427-259fde97936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:28.319914 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:28.404148 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:28.443267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883658d6-b16d-4622-8c61-9b885fbe195c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:28.445331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-883658d6-b16d-4622-8c61-9b885fbe195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:28.551179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883658d6-b16d-4622-8c61-9b885fbe195c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:28.563947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:28.625954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a305629-48cb-4d60-836e-08b8e53c8c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:28.626620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a305629-48cb-4d60-836e-08b8e53c8c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:28.626905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a305629-48cb-4d60-836e-08b8e53c8c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:28.627181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a305629-48cb-4d60-836e-08b8e53c8c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:28.628848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0a305629-48cb-4d60-836e-08b8e53c8c3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:28.739056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a305629-48cb-4d60-836e-08b8e53c8c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:28.740534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a305629-48cb-4d60-836e-08b8e53c8c3c service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:28.758469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 730/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:31.549444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2284-9d35-4db8-9af4-be083355f7b9 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:31.550000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2284-9d35-4db8-9af4-be083355f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:31.550000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2284-9d35-4db8-9af4-be083355f7b9 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:31.551416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:31.556761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8314416-ffde-47f0-9322-6d436f50c6ca None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:31.557197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8314416-ffde-47f0-9322-6d436f50c6ca None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:31.557300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8314416-ffde-47f0-9322-6d436f50c6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:31.604222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:31.627268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a8314416-ffde-47f0-9322-6d436f50c6ca None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:31.628533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a8314416-ffde-47f0-9322-6d436f50c6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:31.727334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:31.766683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2284-9d35-4db8-9af4-be083355f7b9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:31.768252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0d5b2284-9d35-4db8-9af4-be083355f7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:31.882094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2284-9d35-4db8-9af4-be083355f7b9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:31.923195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:31.957285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b9157-7411-430d-a7c2-0055757bbb6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:31.957932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b9157-7411-430d-a7c2-0055757bbb6f service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:31.958221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b9157-7411-430d-a7c2-0055757bbb6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:31.958501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b9157-7411-430d-a7c2-0055757bbb6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:31.960191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-042b9157-7411-430d-a7c2-0055757bbb6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:32.068799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b9157-7411-430d-a7c2-0055757bbb6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:32.070152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b9157-7411-430d-a7c2-0055757bbb6f service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:32.089436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 718/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:34.254058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060ddc-4717-40ff-b975-6ed274c258ac None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:34.254636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060ddc-4717-40ff-b975-6ed274c258ac None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:34.254636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060ddc-4717-40ff-b975-6ed274c258ac None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:34.256078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:34.261260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b751fe-74e4-4ac6-a687-617f841fb5e9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:34.261664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b751fe-74e4-4ac6-a687-617f841fb5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:34.261819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b751fe-74e4-4ac6-a687-617f841fb5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:34.326422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-22b751fe-74e4-4ac6-a687-617f841fb5e9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:34.327731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-22b751fe-74e4-4ac6-a687-617f841fb5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:34.347606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:34.423501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:34.462182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53060ddc-4717-40ff-b975-6ed274c258ac None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:34.464072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-53060ddc-4717-40ff-b975-6ed274c258ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:34.566132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53060ddc-4717-40ff-b975-6ed274c258ac None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:34.585333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:34.637705 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fc796-eac7-435f-a45a-3949e63daa38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:34.638347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fc796-eac7-435f-a45a-3949e63daa38 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:34.638625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fc796-eac7-435f-a45a-3949e63daa38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:34.638898 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fc796-eac7-435f-a45a-3949e63daa38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:34.640707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dc8fc796-eac7-435f-a45a-3949e63daa38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:34.746090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fc796-eac7-435f-a45a-3949e63daa38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:34.747518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fc796-eac7-435f-a45a-3949e63daa38 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:34.766960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 733/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:36.864823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56708c4c-5749-4d5a-b8b2-7e609c941cfc None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:36.865395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56708c4c-5749-4d5a-b8b2-7e609c941cfc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:36.865395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56708c4c-5749-4d5a-b8b2-7e609c941cfc None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:36.866761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:36.871870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34ab1-92a0-4ad0-96a4-c865c52290f2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:36.872329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34ab1-92a0-4ad0-96a4-c865c52290f2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:36.872476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34ab1-92a0-4ad0-96a4-c865c52290f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:36.933534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:36.936964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c3c34ab1-92a0-4ad0-96a4-c865c52290f2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:36.938667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c3c34ab1-92a0-4ad0-96a4-c865c52290f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:37.036857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:37.074354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56708c4c-5749-4d5a-b8b2-7e609c941cfc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:37.075963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-56708c4c-5749-4d5a-b8b2-7e609c941cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:37.178108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56708c4c-5749-4d5a-b8b2-7e609c941cfc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:37.225535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:37.250686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf47a9-f0cb-484a-b09b-0b63c59b8b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:37.251333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf47a9-f0cb-484a-b09b-0b63c59b8b7f service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:37.251616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf47a9-f0cb-484a-b09b-0b63c59b8b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:37.251893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf47a9-f0cb-484a-b09b-0b63c59b8b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:37.253551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-46cf47a9-f0cb-484a-b09b-0b63c59b8b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:37.358714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf47a9-f0cb-484a-b09b-0b63c59b8b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:37.360085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf47a9-f0cb-484a-b09b-0b63c59b8b7f service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:37.378038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 721/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:39.556459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a3ff0-b983-451c-94e6-05a3cb9b86bf None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:39.556935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a3ff0-b983-451c-94e6-05a3cb9b86bf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:39.557028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a3ff0-b983-451c-94e6-05a3cb9b86bf None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:39.558428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:39.564190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91034e48-77d7-4e8c-8881-0a552c7bd801 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:39.564574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91034e48-77d7-4e8c-8881-0a552c7bd801 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:39.564764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91034e48-77d7-4e8c-8881-0a552c7bd801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:39.631157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-91034e48-77d7-4e8c-8881-0a552c7bd801 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:39.632406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-91034e48-77d7-4e8c-8881-0a552c7bd801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:39.662265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:39.730242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:39.768224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a3ff0-b983-451c-94e6-05a3cb9b86bf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:39.769763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fe0a3ff0-b983-451c-94e6-05a3cb9b86bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:39.872750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a3ff0-b983-451c-94e6-05a3cb9b86bf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:39.906488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:39.952782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b1418-6494-41a5-8cae-38e960a04820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:39.953438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b1418-6494-41a5-8cae-38e960a04820 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:39.953727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b1418-6494-41a5-8cae-38e960a04820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:39.954007 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b1418-6494-41a5-8cae-38e960a04820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:39.955676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6d8b1418-6494-41a5-8cae-38e960a04820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:40.062711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b1418-6494-41a5-8cae-38e960a04820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:40.064102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b1418-6494-41a5-8cae-38e960a04820 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:40.082694 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 736/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:42.162819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64917a2-9656-4230-99ca-eddb10e05acd None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:42.163363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64917a2-9656-4230-99ca-eddb10e05acd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:42.163363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64917a2-9656-4230-99ca-eddb10e05acd None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:42.164803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:42.170065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107669-3b52-4b65-9dcf-508b6746e477 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:42.170470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107669-3b52-4b65-9dcf-508b6746e477 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:42.170582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107669-3b52-4b65-9dcf-508b6746e477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:42.233860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b4107669-3b52-4b65-9dcf-508b6746e477 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:42.235053 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b4107669-3b52-4b65-9dcf-508b6746e477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:42.243166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:42.331062 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:42.370041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64917a2-9656-4230-99ca-eddb10e05acd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:42.371649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c64917a2-9656-4230-99ca-eddb10e05acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:42.472958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64917a2-9656-4230-99ca-eddb10e05acd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:42.525892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:42.544402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e0b43-1c0e-4f6f-bff7-6789b111ce86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:42.545064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e0b43-1c0e-4f6f-bff7-6789b111ce86 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:42.545905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e0b43-1c0e-4f6f-bff7-6789b111ce86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:42.546358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e0b43-1c0e-4f6f-bff7-6789b111ce86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:42.548040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ef6e0b43-1c0e-4f6f-bff7-6789b111ce86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:42.654350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e0b43-1c0e-4f6f-bff7-6789b111ce86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:42.656292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e0b43-1c0e-4f6f-bff7-6789b111ce86 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:42.674281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 724/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:44.758433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262ff3-1fad-4e11-9fd5-b4e875e4f92e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:44.758996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262ff3-1fad-4e11-9fd5-b4e875e4f92e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:44.758996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262ff3-1fad-4e11-9fd5-b4e875e4f92e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:44.760474 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:44.765796 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f737a-ed6f-4720-add3-38d4b759d44d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:44.766253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f737a-ed6f-4720-add3-38d4b759d44d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:44.766360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f737a-ed6f-4720-add3-38d4b759d44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:44.836258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b52f737a-ed6f-4720-add3-38d4b759d44d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:44.837462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b52f737a-ed6f-4720-add3-38d4b759d44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:44.876338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:44.933453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:44.972120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262ff3-1fad-4e11-9fd5-b4e875e4f92e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:44.973673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1b262ff3-1fad-4e11-9fd5-b4e875e4f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:45.074010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262ff3-1fad-4e11-9fd5-b4e875e4f92e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:45.111084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:45.148003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb875c-9ad8-43fb-85a0-275a163a9f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:45.148662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb875c-9ad8-43fb-85a0-275a163a9f54 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:45.148951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb875c-9ad8-43fb-85a0-275a163a9f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:45.149228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb875c-9ad8-43fb-85a0-275a163a9f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:45.150887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-16eb875c-9ad8-43fb-85a0-275a163a9f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:45.258346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb875c-9ad8-43fb-85a0-275a163a9f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:45.259813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb875c-9ad8-43fb-85a0-275a163a9f54 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:45.277991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 739/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:47.337734 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175efeff-5be5-4e0f-b3a1-78b08201a6d3 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:47.338546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175efeff-5be5-4e0f-b3a1-78b08201a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:47.338546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175efeff-5be5-4e0f-b3a1-78b08201a6d3 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:47.339950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:47.345435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df36a3f-3c2f-48de-8f0d-a27e6943e532 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:47.345862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df36a3f-3c2f-48de-8f0d-a27e6943e532 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:47.345998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df36a3f-3c2f-48de-8f0d-a27e6943e532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:47.410002 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6df36a3f-3c2f-48de-8f0d-a27e6943e532 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:47.411126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6df36a3f-3c2f-48de-8f0d-a27e6943e532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:47.429933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:47.513085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:47.549147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175efeff-5be5-4e0f-b3a1-78b08201a6d3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:47.550685 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-175efeff-5be5-4e0f-b3a1-78b08201a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:47.651967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175efeff-5be5-4e0f-b3a1-78b08201a6d3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:47.717938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:47.724938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236e3be-88e1-46f7-9aea-23731fce5014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:47.725596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e3be-88e1-46f7-9aea-23731fce5014 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:47.725878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e3be-88e1-46f7-9aea-23731fce5014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:47.726156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e3be-88e1-46f7-9aea-23731fce5014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:47.727805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5236e3be-88e1-46f7-9aea-23731fce5014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:47.838398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236e3be-88e1-46f7-9aea-23731fce5014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:47.839835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236e3be-88e1-46f7-9aea-23731fce5014 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:47.859007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 727/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:05:49.922924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845c17c-ed61-4076-9e30-40dee31973fc None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:49.923557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845c17c-ed61-4076-9e30-40dee31973fc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:49.923557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845c17c-ed61-4076-9e30-40dee31973fc None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:49.924804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:05:49.930809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed42cb2-dadd-4b63-a9e3-d7df29fc4473 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:49.931303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed42cb2-dadd-4b63-a9e3-d7df29fc4473 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:49.931414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed42cb2-dadd-4b63-a9e3-d7df29fc4473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:50.001740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5ed42cb2-dadd-4b63-a9e3-d7df29fc4473 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:05:50.002968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5ed42cb2-dadd-4b63-a9e3-d7df29fc4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:50.054534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:50.121560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:05:50.178202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845c17c-ed61-4076-9e30-40dee31973fc None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:05:50.179770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6845c17c-ed61-4076-9e30-40dee31973fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:50.313464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845c17c-ed61-4076-9e30-40dee31973fc None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:05:50.368418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:05:50.399602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a95ed-d46c-450a-841c-c1d315536330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:05:50.400278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a95ed-d46c-450a-841c-c1d315536330 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:05:50.400563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a95ed-d46c-450a-841c-c1d315536330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:05:50.400839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a95ed-d46c-450a-841c-c1d315536330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:05:50.402505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-814a95ed-d46c-450a-841c-c1d315536330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:05:50.518190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a95ed-d46c-450a-841c-c1d315536330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:05:50.519632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a95ed-d46c-450a-841c-c1d315536330 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:05:50.538428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 742/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:06:00.118892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=22 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:00.535828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=66 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:10.463702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a109-961d-463b-a0aa-b2d4d2c9afbd None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:10.464261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a109-961d-463b-a0aa-b2d4d2c9afbd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:10.464261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a109-961d-463b-a0aa-b2d4d2c9afbd None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:10.465619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 729/1471] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:06:10.471099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae3bc-671f-41e1-b939-38a0d015483f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:10.471508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae3bc-671f-41e1-b939-38a0d015483f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:10.471659 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae3bc-671f-41e1-b939-38a0d015483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:10.534661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fd5ae3bc-671f-41e1-b939-38a0d015483f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:06:10.535864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fd5ae3bc-671f-41e1-b939-38a0d015483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:10.631256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 743/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:06:10.715117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcd009-5725-471e-9312-2cd88801dab2 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:10.715376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcd009-5725-471e-9312-2cd88801dab2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:10.715657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcd009-5725-471e-9312-2cd88801dab2 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:10.717727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 730/1473] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jul 13 22:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:06:10.722576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50253-5f59-4269-b985-6b47ba4cba42 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:10.722863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50253-5f59-4269-b985-6b47ba4cba42 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:10.723137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50253-5f59-4269-b985-6b47ba4cba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:10.798910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0fa50253-5f59-4269-b985-6b47ba4cba42 None None] MFA Rules not processed for user `46a7d9cfbbcd4068aa9241ffd694c631`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:06:10.800135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0fa50253-5f59-4269-b985-6b47ba4cba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:10.820202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:10.876266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 744/1474] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jul 13 22:06:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:06:10.883790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcd009-5725-471e-9312-2cd88801dab2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:06:10.885357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f0dcd009-5725-471e-9312-2cd88801dab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:10.986147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcd009-5725-471e-9312-2cd88801dab2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:06:11.056707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f4b3f-2c0f-47e6-952f-e9334592393e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7d9cfbbcd4068aa9241ffd694c631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:06:11.057357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4b3f-2c0f-47e6-952f-e9334592393e service glance] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:11.057646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4b3f-2c0f-47e6-952f-e9334592393e service glance] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:11.057924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4b3f-2c0f-47e6-952f-e9334592393e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:11.059564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f60f4b3f-2c0f-47e6-952f-e9334592393e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:11.115095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:11.171821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f4b3f-2c0f-47e6-952f-e9334592393e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:06:11.173277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f4b3f-2c0f-47e6-952f-e9334592393e service glance] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:06:11.191676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 731/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:06:13.327257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093e31-11b9-4a65-8567-396127864b61 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:13.327819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093e31-11b9-4a65-8567-396127864b61 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:13.327819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093e31-11b9-4a65-8567-396127864b61 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:13.329211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 745/1476] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:06:13.334601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840fa4-974a-4112-add8-055f6d2c26d8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:13.335045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840fa4-974a-4112-add8-055f6d2c26d8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:13.335160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840fa4-974a-4112-add8-055f6d2c26d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:13.397744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-18840fa4-974a-4112-add8-055f6d2c26d8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:06:13.398868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-18840fa4-974a-4112-add8-055f6d2c26d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:13.494600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 732/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:06:13.518940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093e31-11b9-4a65-8567-396127864b61 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:06:13.520525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-05093e31-11b9-4a65-8567-396127864b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:13.645766 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093e31-11b9-4a65-8567-396127864b61 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:06:13.693298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:13.737411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bf9ef-95cf-422d-a4ab-5ddb6ccf8b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:06:13.738070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bf9ef-95cf-422d-a4ab-5ddb6ccf8b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:13.738351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bf9ef-95cf-422d-a4ab-5ddb6ccf8b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:13.738624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bf9ef-95cf-422d-a4ab-5ddb6ccf8b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:13.739343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bf9ef-95cf-422d-a4ab-5ddb6ccf8b48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:06:13.741084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-c54bf9ef-95cf-422d-a4ab-5ddb6ccf8b48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:06:13.741084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 13 22:06:13.741084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: Jul 13 22:06:13.742213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bf9ef-95cf-422d-a4ab-5ddb6ccf8b48 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:06:13.761105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 746/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 22:06:13 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:06:15.810794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052182b-5eab-4dda-8b93-49554b01418a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:15.811315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052182b-5eab-4dda-8b93-49554b01418a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:15.811315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052182b-5eab-4dda-8b93-49554b01418a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:15.812701 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 733/1479] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:06:15.817835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73e329-6775-44c4-9cbd-583f13db0a40 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:15.818275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73e329-6775-44c4-9cbd-583f13db0a40 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:15.818380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73e329-6775-44c4-9cbd-583f13db0a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:15.882574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5e73e329-6775-44c4-9cbd-583f13db0a40 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:06:15.883801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5e73e329-6775-44c4-9cbd-583f13db0a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:15.980125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 747/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:06:16.023245 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052182b-5eab-4dda-8b93-49554b01418a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:06:16.024875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d052182b-5eab-4dda-8b93-49554b01418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:16.035309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:16.170223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052182b-5eab-4dda-8b93-49554b01418a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:06:16.248651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:16.282559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce86efe-bfe3-4b63-a62f-4b89fd554858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:06:16.283222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce86efe-bfe3-4b63-a62f-4b89fd554858 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:16.283510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce86efe-bfe3-4b63-a62f-4b89fd554858 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:16.283794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce86efe-bfe3-4b63-a62f-4b89fd554858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:16.285495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1ce86efe-bfe3-4b63-a62f-4b89fd554858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:16.376234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce86efe-bfe3-4b63-a62f-4b89fd554858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:06:16.378608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce86efe-bfe3-4b63-a62f-4b89fd554858 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:06:16.400164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 734/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:06:18.592419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebd215-b94b-473d-a0a1-a15c6ac9f7b4 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:18.592997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebd215-b94b-473d-a0a1-a15c6ac9f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:18.592997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebd215-b94b-473d-a0a1-a15c6ac9f7b4 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:18.594424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 748/1482] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:06:18.599710 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7323b-04e1-470c-9c94-f147a922d584 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:18.600180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7323b-04e1-470c-9c94-f147a922d584 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:18.600296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7323b-04e1-470c-9c94-f147a922d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:18.663063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bca7323b-04e1-470c-9c94-f147a922d584 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:06:18.664286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bca7323b-04e1-470c-9c94-f147a922d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:18.709505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:18.759644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 735/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:06:18.796882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebd215-b94b-473d-a0a1-a15c6ac9f7b4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:06:18.798809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bcebd215-b94b-473d-a0a1-a15c6ac9f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:18.822203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:18.901319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebd215-b94b-473d-a0a1-a15c6ac9f7b4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:06:18.973635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03ec10-a942-496c-a447-1483551695c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:06:18.974280 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03ec10-a942-496c-a447-1483551695c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:18.974578 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03ec10-a942-496c-a447-1483551695c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:18.974836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03ec10-a942-496c-a447-1483551695c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:18.976492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9c03ec10-a942-496c-a447-1483551695c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:19.048437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:19.083732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03ec10-a942-496c-a447-1483551695c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:06:19.085199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03ec10-a942-496c-a447-1483551695c1 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:06:19.103927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 749/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:06:21.176574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753902e-8af8-476f-b66d-c33888db36f0 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:21.177064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753902e-8af8-476f-b66d-c33888db36f0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:21.177172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753902e-8af8-476f-b66d-c33888db36f0 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:21.178529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 736/1485] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:06:21.183916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1a3e-f27e-445b-b38d-17c7feaee031 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:21.184318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1a3e-f27e-445b-b38d-17c7feaee031 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:21.184538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1a3e-f27e-445b-b38d-17c7feaee031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:21.249065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-317d1a3e-f27e-445b-b38d-17c7feaee031 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:06:21.250281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-317d1a3e-f27e-445b-b38d-17c7feaee031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:21.345671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 750/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:06:21.383430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753902e-8af8-476f-b66d-c33888db36f0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:06:21.386012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7753902e-8af8-476f-b66d-c33888db36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:21.490532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753902e-8af8-476f-b66d-c33888db36f0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:06:21.562142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:21.563774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768c1f0-8a3a-4b5a-b268-43bb2250e92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:06:21.564464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768c1f0-8a3a-4b5a-b268-43bb2250e92b service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:21.564809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768c1f0-8a3a-4b5a-b268-43bb2250e92b service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:21.565276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768c1f0-8a3a-4b5a-b268-43bb2250e92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:21.567276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e768c1f0-8a3a-4b5a-b268-43bb2250e92b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:21.679436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768c1f0-8a3a-4b5a-b268-43bb2250e92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:06:21.680796 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768c1f0-8a3a-4b5a-b268-43bb2250e92b service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:06:21.699425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 737/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:06:23.887772 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbde692-dc2b-4f49-a7c9-72f85bd6956d None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:23.888340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbde692-dc2b-4f49-a7c9-72f85bd6956d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:23.888340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbde692-dc2b-4f49-a7c9-72f85bd6956d None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:23.889746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 751/1488] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:06:23.894952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e09d1a-cf07-4ae2-b158-437717ce981c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:23.895398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e09d1a-cf07-4ae2-b158-437717ce981c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:23.895501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e09d1a-cf07-4ae2-b158-437717ce981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:23.960569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b0e09d1a-cf07-4ae2-b158-437717ce981c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:06:23.961781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b0e09d1a-cf07-4ae2-b158-437717ce981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:24.014040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:24.057340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 738/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:06:24.097564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbde692-dc2b-4f49-a7c9-72f85bd6956d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:06:24.099096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5dbde692-dc2b-4f49-a7c9-72f85bd6956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:24.137077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:24.204040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbde692-dc2b-4f49-a7c9-72f85bd6956d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:06:24.277174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9138f-2cb6-449d-b53f-ad2657affa62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:06:24.277823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9138f-2cb6-449d-b53f-ad2657affa62 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:24.278109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9138f-2cb6-449d-b53f-ad2657affa62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:24.278925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9138f-2cb6-449d-b53f-ad2657affa62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:24.280805 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5ea9138f-2cb6-449d-b53f-ad2657affa62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:24.359636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:24.388403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9138f-2cb6-449d-b53f-ad2657affa62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:06:24.389833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9138f-2cb6-449d-b53f-ad2657affa62 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:06:24.408317 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 752/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:06:26.611650 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aacd97-af7a-46ec-a37e-2583dc2c4128 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:26.612232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aacd97-af7a-46ec-a37e-2583dc2c4128 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:26.612344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aacd97-af7a-46ec-a37e-2583dc2c4128 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:26.613703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 739/1491] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 22:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:06:26.618787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6dc69-970a-434f-a48d-ab486977e381 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:26.619190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6dc69-970a-434f-a48d-ab486977e381 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:26.619354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6dc69-970a-434f-a48d-ab486977e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:26.682438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-89e6dc69-970a-434f-a48d-ab486977e381 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:06:26.683652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-89e6dc69-970a-434f-a48d-ab486977e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:26.777540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 753/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 22:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:06:26.817176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aacd97-af7a-46ec-a37e-2583dc2c4128 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:06:26.818758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-06aacd97-af7a-46ec-a37e-2583dc2c4128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:26.922979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aacd97-af7a-46ec-a37e-2583dc2c4128 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:06:26.995589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd5994-1802-44ec-9236-377bfa169ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:06:26.996263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5994-1802-44ec-9236-377bfa169ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:06:26.996548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5994-1802-44ec-9236-377bfa169ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:06:26.996824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5994-1802-44ec-9236-377bfa169ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:06:26.998546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f0bd5994-1802-44ec-9236-377bfa169ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:06:27.007320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:27.107432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd5994-1802-44ec-9236-377bfa169ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:06:27.108936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd5994-1802-44ec-9236-377bfa169ce2 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:06:27.126890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 740/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:06:36.775696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=82 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:06:37.124623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=50 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:00.869496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c6e64-0207-4abc-89ff-d89008ff4df5 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:00.870291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c6e64-0207-4abc-89ff-d89008ff4df5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:00.870291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c6e64-0207-4abc-89ff-d89008ff4df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:00.944429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d94c6e64-0207-4abc-89ff-d89008ff4df5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:08:00.945629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d94c6e64-0207-4abc-89ff-d89008ff4df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:01.041346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 754/1494] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:08:01.049838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61306-592b-4631-82a3-e2dd4ee9d42a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:01.050319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61306-592b-4631-82a3-e2dd4ee9d42a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:01.050421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61306-592b-4631-82a3-e2dd4ee9d42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:01.126378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-53d61306-592b-4631-82a3-e2dd4ee9d42a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:08:01.127525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-53d61306-592b-4631-82a3-e2dd4ee9d42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:01.225977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 741/1495] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:08:01.230661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c6e64-0207-4abc-89ff-d89008ff4df5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:01.231870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d94c6e64-0207-4abc-89ff-d89008ff4df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:01.243166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c6e64-0207-4abc-89ff-d89008ff4df5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:01.303882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:01.337167 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:01.337824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:01.338362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:01.338725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:01.339575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:08:01.339882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:01.340930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:08:01.340930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 13 22:08:01.340930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: Jul 13 22:08:01.341810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:01.352665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 755/1496] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:08:01.361598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61306-592b-4631-82a3-e2dd4ee9d42a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:01.371247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61306-592b-4631-82a3-e2dd4ee9d42a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:01.430225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:01.463972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:01.464629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:01.464914 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:01.465189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:01.465894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:01.467597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:08:01.467597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 13 22:08:01.467597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: Jul 13 22:08:01.468821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:01.523441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 742/1497] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:08:01 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:08:01.527817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:01.529370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:01.563111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e76ed2-738f-4119-8750-0211e1b81796 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:01.655921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:01.656604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:01.656889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:01.657168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:01.657851 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:01.658859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:08:01.658859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 13 22:08:01.658859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: Jul 13 22:08:01.660239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:01.701071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 756/1498] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:08:01 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:08:01.705026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:01.706537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:01.767181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468b7b2-5d1a-49ce-999a-512a3862d512 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:01.849742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:01.861369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:01.862044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:01.862332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:01.862615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:01.863352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:01.864383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:08:01.864383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 13 22:08:01.864383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: Jul 13 22:08:01.865272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:01.878568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 743/1499] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:08:01.882583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:01.884191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:01.896326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49f0fb-1186-4276-a852-1a7c21548ef5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:01.920615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:01.990458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dea6d6-1a49-4bd6-9cb9-ca6215016351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:01.991113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dea6d6-1a49-4bd6-9cb9-ca6215016351 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:01.991394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dea6d6-1a49-4bd6-9cb9-ca6215016351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:01.991667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dea6d6-1a49-4bd6-9cb9-ca6215016351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:01.992418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dea6d6-1a49-4bd6-9cb9-ca6215016351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:01.993427 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-c9dea6d6-1a49-4bd6-9cb9-ca6215016351 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:08:01.993427 dv-cinder-799871-28-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 13 22:08:01.993427 dv-cinder-799871-28-smb devstack@keystone.service[80411]: Jul 13 22:08:01.994301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dea6d6-1a49-4bd6-9cb9-ca6215016351 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:02.007034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 757/1500] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:08:02.012176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:02.013749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:02.047097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84ffc9-f046-447f-8c4c-c36993916f50 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:02.140237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd3fc2-4e78-4a5c-b771-c2294e39babd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:02.141128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd3fc2-4e78-4a5c-b771-c2294e39babd admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:02.141410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd3fc2-4e78-4a5c-b771-c2294e39babd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:02.141684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd3fc2-4e78-4a5c-b771-c2294e39babd admin admin] PATH_INFO: `/v3/projects/d9e39186b5ff4ef6871857ec1f6b015a/users/31a601de8735421a995651a5c3b270fe/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:02.163782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd3fc2-4e78-4a5c-b771-c2294e39babd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e39186b5ff4ef6871857ec1f6b015a, user_id=31a601de8735421a995651a5c3b270fe, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:02.164906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-6edd3fc2-4e78-4a5c-b771-c2294e39babd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:08:02.164906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 13 22:08:02.164906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: Jul 13 22:08:02.167078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd3fc2-4e78-4a5c-b771-c2294e39babd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:02.191321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 744/1501] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:08:02 2022] PUT /identity/v3/projects/d9e39186b5ff4ef6871857ec1f6b015a/users/31a601de8735421a995651a5c3b270fe/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:08:02.203764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad359-f201-41b3-80b9-ebfda4410cf8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:02.204084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad359-f201-41b3-80b9-ebfda4410cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:02.204368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad359-f201-41b3-80b9-ebfda4410cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:02.259161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-592ad359-f201-41b3-80b9-ebfda4410cf8 None None] MFA Rules not processed for user `31a601de8735421a995651a5c3b270fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:08:02.260335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-592ad359-f201-41b3-80b9-ebfda4410cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:02.337217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 758/1502] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:08:02.351376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390aa48-80cb-4a6d-8854-b47d862aab73 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:02.351671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390aa48-80cb-4a6d-8854-b47d862aab73 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:02.351991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390aa48-80cb-4a6d-8854-b47d862aab73 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:02.353401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 745/1503] 10.222.0.17 () {54 vars in 963 bytes} [Wed Jul 13 22:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:08:02.358291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d7a45-3582-42bb-ad5f-3c84fdacd717 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:02.358583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d7a45-3582-42bb-ad5f-3c84fdacd717 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:02.358862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d7a45-3582-42bb-ad5f-3c84fdacd717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:02.390186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:02.432781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-df3d7a45-3582-42bb-ad5f-3c84fdacd717 None None] MFA Rules not processed for user `b6d929086ac74f1bb5f323cca822fbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:08:02.434487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-df3d7a45-3582-42bb-ad5f-3c84fdacd717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:02.508298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 759/1504] 10.222.0.17 () {58 vars in 1060 bytes} [Wed Jul 13 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:08:02.516800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390aa48-80cb-4a6d-8854-b47d862aab73 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:02.518241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9390aa48-80cb-4a6d-8854-b47d862aab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:02.567008 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:02.624354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390aa48-80cb-4a6d-8854-b47d862aab73 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:02.700897 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:02.701551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:02.701840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:02.702122 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:02.703781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:02.801156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:02.802565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:02.806064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:02.821522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 746/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:08:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:08:02.863160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730b41-4dca-4a2d-a64f-7581751df80e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:02.863455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730b41-4dca-4a2d-a64f-7581751df80e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:02.863734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730b41-4dca-4a2d-a64f-7581751df80e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:02.865076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 760/1506] 10.222.0.17 () {52 vars in 829 bytes} [Wed Jul 13 22:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:08:02.868751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:02.869972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:02.967908 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45146c7b-6e1e-4b26-99b5-e3bf3f42463a service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:03.061932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:03.062748 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:03.063018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:03.063299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] PATH_INFO: `/v3/users/31a601de8735421a995651a5c3b270fe` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:03.075838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a601de8735421a995651a5c3b270fe)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:03.076888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:08:03.076888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 13 22:08:03.076888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: Jul 13 22:08:03.078084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:03.087472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:03.141870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a601de8735421a995651a5c3b270fe'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:03.151420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a601de8735421a995651a5c3b270fe'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:03.151842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a601de8735421a995651a5c3b270fe'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:03.170278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a601de8735421a995651a5c3b270fe'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:03.170819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a601de8735421a995651a5c3b270fe'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:03.187705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 747/1507] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:08:02 2022] DELETE /identity/v3/users/31a601de8735421a995651a5c3b270fe => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:08:03.192219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcdeef-3e88-4fb8-9c71-0b5110c2723d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:03.192702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcdeef-3e88-4fb8-9c71-0b5110c2723d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:03.192810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcdeef-3e88-4fb8-9c71-0b5110c2723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:03.249544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-55bcdeef-3e88-4fb8-9c71-0b5110c2723d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:08:03.250755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-55bcdeef-3e88-4fb8-9c71-0b5110c2723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:03.323463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:03.338580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 761/1508] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:08:03.348556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:03.349778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:03.450245 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969304fc-66b3-4246-a863-f94523721384 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:03.505520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:03.526925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35816dab-6fb2-45f7-9ec4-1866247aae3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:03.527788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816dab-6fb2-45f7-9ec4-1866247aae3b service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:03.528102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816dab-6fb2-45f7-9ec4-1866247aae3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:03.528387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816dab-6fb2-45f7-9ec4-1866247aae3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:03.530037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-35816dab-6fb2-45f7-9ec4-1866247aae3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:03.637269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35816dab-6fb2-45f7-9ec4-1866247aae3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:03.638813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35816dab-6fb2-45f7-9ec4-1866247aae3b service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:03.657025 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 748/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:08:03.982201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcdeef-3e88-4fb8-9c71-0b5110c2723d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:08:03.983455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-55bcdeef-3e88-4fb8-9c71-0b5110c2723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:08:03.994806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcdeef-3e88-4fb8-9c71-0b5110c2723d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:08:04.092633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:08:04.093491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:08:04.093771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:08:04.094050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] PATH_INFO: `/v3/projects/d9e39186b5ff4ef6871857ec1f6b015a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:08:04.103766 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e39186b5ff4ef6871857ec1f6b015a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:08:04.104834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:08:04.104834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 13 22:08:04.104834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: Jul 13 22:08:04.106581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:08:04.163038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e39186b5ff4ef6871857ec1f6b015a', 'request_id': 'req-e7856f25-503d-4e6e-9836-3d276540e61d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:04.176615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e39186b5ff4ef6871857ec1f6b015a', 'request_id': 'req-e7856f25-503d-4e6e-9836-3d276540e61d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:04.186906 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e39186b5ff4ef6871857ec1f6b015a', 'request_id': 'req-e7856f25-503d-4e6e-9836-3d276540e61d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:04.209801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] The token cache is being invalidate because project d9e39186b5ff4ef6871857ec1f6b015a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:08:04.210428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:04.210599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e7856f25-503d-4e6e-9836-3d276540e61d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:08:04.211978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 762/1510] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:08:03 2022] DELETE /identity/v3/projects/d9e39186b5ff4ef6871857ec1f6b015a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:08:13.654719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=62 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:08:14.207763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:09:52.966680 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5282ac-5fab-4fbe-b124-9c5e73cb6218 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:09:52.967250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5282ac-5fab-4fbe-b124-9c5e73cb6218 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:09:52.967250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5282ac-5fab-4fbe-b124-9c5e73cb6218 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:09:52.968643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:09:52.973488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d54af-8736-47fa-9e2a-7b0b779f0814 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:09:52.973930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d54af-8736-47fa-9e2a-7b0b779f0814 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:09:52.974062 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d54af-8736-47fa-9e2a-7b0b779f0814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:09:53.052207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fa7d54af-8736-47fa-9e2a-7b0b779f0814 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:09:53.053419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fa7d54af-8736-47fa-9e2a-7b0b779f0814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:09:53.157580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:09:53.311746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5282ac-5fab-4fbe-b124-9c5e73cb6218 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:09:53.313911 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8b5282ac-5fab-4fbe-b124-9c5e73cb6218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:09:53.437964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5282ac-5fab-4fbe-b124-9c5e73cb6218 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:09:53.443361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad34d5-f2dd-43a1-9452-b71c0af43f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:09:53.444039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad34d5-f2dd-43a1-9452-b71c0af43f09 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:09:53.444329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad34d5-f2dd-43a1-9452-b71c0af43f09 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:09:53.444609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad34d5-f2dd-43a1-9452-b71c0af43f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:09:53.452579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad34d5-f2dd-43a1-9452-b71c0af43f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:09:53.454150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad34d5-f2dd-43a1-9452-b71c0af43f09 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:09:53.463541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 750/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:09:54.063324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820a339-ae22-40a2-8b0b-f3fb9d090024 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:09:54.063860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820a339-ae22-40a2-8b0b-f3fb9d090024 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:09:54.064014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820a339-ae22-40a2-8b0b-f3fb9d090024 None None] PATH_INFO: `/v3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:09:54.065864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 764/1514] 10.222.0.40 () {54 vars in 925 bytes} [Wed Jul 13 22:09:54 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:09:54.073447 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d2e85-4d30-4800-9903-812916419821 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:09:54.074984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d2e85-4d30-4800-9903-812916419821 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:09:54.074984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d2e85-4d30-4800-9903-812916419821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:09:54.150308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-888d2e85-4d30-4800-9903-812916419821 None None] MFA Rules not processed for user `1dd6827b3db547b58560a1d4f89e9c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:09:54.151538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-888d2e85-4d30-4800-9903-812916419821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:09:54.227573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:09:54.236078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 751/1515] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jul 13 22:09:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:09:54.386944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c0b3d-24f1-4268-b4ec-964ec7b85836 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:09:54.387230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c0b3d-24f1-4268-b4ec-964ec7b85836 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:09:54.387496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c0b3d-24f1-4268-b4ec-964ec7b85836 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:09:54.389482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 765/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:09:54.400898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9612b0-2ec8-443d-b4f2-e7b2e3cb8604 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:09:54.401194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9612b0-2ec8-443d-b4f2-e7b2e3cb8604 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:09:54.401479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9612b0-2ec8-443d-b4f2-e7b2e3cb8604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:09:54.427498 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1b9612b0-2ec8-443d-b4f2-e7b2e3cb8604 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:09:54.428923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1b9612b0-2ec8-443d-b4f2-e7b2e3cb8604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:09:54.443630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 752/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:09:54.615176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c0b3d-24f1-4268-b4ec-964ec7b85836 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:09:54.629289 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c0b3d-24f1-4268-b4ec-964ec7b85836 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:09:54.634647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16105016-2299-4a43-b906-81c1bdda7bfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:09:54.635277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16105016-2299-4a43-b906-81c1bdda7bfd service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:09:54.635561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16105016-2299-4a43-b906-81c1bdda7bfd service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:09:54.635837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16105016-2299-4a43-b906-81c1bdda7bfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:09:54.644247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16105016-2299-4a43-b906-81c1bdda7bfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:09:54.645823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16105016-2299-4a43-b906-81c1bdda7bfd service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:09:54.656033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 766/1518] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:10:03.007642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b274c-0de5-4299-b650-d6d834570c66 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:03.008302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b274c-0de5-4299-b650-d6d834570c66 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:03.008302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b274c-0de5-4299-b650-d6d834570c66 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:03.009540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 753/1519] 10.222.0.17 () {54 vars in 960 bytes} [Wed Jul 13 22:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:10:03.015086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338c905-7e00-4475-ab3b-168e1927c29c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:03.015535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338c905-7e00-4475-ab3b-168e1927c29c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:03.015642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338c905-7e00-4475-ab3b-168e1927c29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:03.035372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e338c905-7e00-4475-ab3b-168e1927c29c None None] MFA Rules not processed for user `1dd6827b3db547b58560a1d4f89e9c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:10:03.036610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e338c905-7e00-4475-ab3b-168e1927c29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:03.045601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 767/1520] 10.222.0.17 () {58 vars in 1057 bytes} [Wed Jul 13 22:10:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:10:03.053133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b274c-0de5-4299-b650-d6d834570c66 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:10:03.067105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b274c-0de5-4299-b650-d6d834570c66 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:10:03.072026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2771ee-e92c-40ef-98db-6bdc74c7241f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:10:03.072660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2771ee-e92c-40ef-98db-6bdc74c7241f service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:03.072944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2771ee-e92c-40ef-98db-6bdc74c7241f service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:03.073246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2771ee-e92c-40ef-98db-6bdc74c7241f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:03.081672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2771ee-e92c-40ef-98db-6bdc74c7241f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:10:03.083240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2771ee-e92c-40ef-98db-6bdc74c7241f service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:10:03.093220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 754/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:10:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:10:05.881114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a430509-1334-4496-b0b1-803910ae6f1c None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:05.881634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a430509-1334-4496-b0b1-803910ae6f1c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:05.881634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a430509-1334-4496-b0b1-803910ae6f1c None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:05.882979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:10:05.888587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6d1d0-911f-41a8-8c83-b3bb09112db6 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:05.889054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6d1d0-911f-41a8-8c83-b3bb09112db6 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:05.889187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6d1d0-911f-41a8-8c83-b3bb09112db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:05.906849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2bd6d1d0-911f-41a8-8c83-b3bb09112db6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:10:05.908074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2bd6d1d0-911f-41a8-8c83-b3bb09112db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:05.915747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:10:06.074571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a430509-1334-4496-b0b1-803910ae6f1c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:10:06.088987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a430509-1334-4496-b0b1-803910ae6f1c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:10:06.094990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ef6e6-65ba-48eb-b69b-5298d4f991c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:10:06.095623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ef6e6-65ba-48eb-b69b-5298d4f991c7 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:06.095929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ef6e6-65ba-48eb-b69b-5298d4f991c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:06.096217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ef6e6-65ba-48eb-b69b-5298d4f991c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:06.104401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ef6e6-65ba-48eb-b69b-5298d4f991c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:10:06.106331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ef6e6-65ba-48eb-b69b-5298d4f991c7 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:10:06.116312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 769/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:10:06.938930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494715-6b4e-4d39-a8a6-0e043b22cb5e None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:06.939464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494715-6b4e-4d39-a8a6-0e043b22cb5e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:06.939464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494715-6b4e-4d39-a8a6-0e043b22cb5e None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:06.940882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 22:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:10:06.945693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425ac15-e21e-423a-aade-2ddcb38fd830 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:06.946105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425ac15-e21e-423a-aade-2ddcb38fd830 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:06.946284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425ac15-e21e-423a-aade-2ddcb38fd830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:06.964569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a425ac15-e21e-423a-aade-2ddcb38fd830 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:10:06.966466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a425ac15-e21e-423a-aade-2ddcb38fd830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:06.974231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 22:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:10:07.131492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494715-6b4e-4d39-a8a6-0e043b22cb5e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:10:07.146002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494715-6b4e-4d39-a8a6-0e043b22cb5e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:10:07.151426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbad7f-2413-4930-a476-30fb5248b2db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:10:07.152095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbad7f-2413-4930-a476-30fb5248b2db service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:07.153071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbad7f-2413-4930-a476-30fb5248b2db service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:07.153389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbad7f-2413-4930-a476-30fb5248b2db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:07.161549 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbad7f-2413-4930-a476-30fb5248b2db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:10:07.163124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbad7f-2413-4930-a476-30fb5248b2db service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:10:07.173189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 757/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:10:11.042326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223cefa-59a0-4f53-820a-380f008fdc62 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:11.043051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223cefa-59a0-4f53-820a-380f008fdc62 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:11.043464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223cefa-59a0-4f53-820a-380f008fdc62 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:11.044908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:10:11.050034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c55b5-d9ab-4279-a0e5-0b0fcff6f505 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:11.050481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c55b5-d9ab-4279-a0e5-0b0fcff6f505 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:11.050580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c55b5-d9ab-4279-a0e5-0b0fcff6f505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:11.068720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3a0c55b5-d9ab-4279-a0e5-0b0fcff6f505 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:10:11.069900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3a0c55b5-d9ab-4279-a0e5-0b0fcff6f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:11.078229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:10:11.150849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223cefa-59a0-4f53-820a-380f008fdc62 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:10:11.152654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4223cefa-59a0-4f53-820a-380f008fdc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:11.189752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:10:11.235219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223cefa-59a0-4f53-820a-380f008fdc62 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:10:11.238784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9da67b-6bba-45a5-bf02-56e9059235c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:10:11.239424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9da67b-6bba-45a5-bf02-56e9059235c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:11.239711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9da67b-6bba-45a5-bf02-56e9059235c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:11.240019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9da67b-6bba-45a5-bf02-56e9059235c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:11.249831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9da67b-6bba-45a5-bf02-56e9059235c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:10:11.252284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9da67b-6bba-45a5-bf02-56e9059235c5 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:10:11.262928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 772/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:10:13.301289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2ae9-750a-47e2-a944-455ab6bed264 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:13.301841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2ae9-750a-47e2-a944-455ab6bed264 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:13.301841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2ae9-750a-47e2-a944-455ab6bed264 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:13.303241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:10:13.309116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15b08c-742e-4ba6-a672-d57075a45bce None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:13.309116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15b08c-742e-4ba6-a672-d57075a45bce None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:13.309668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15b08c-742e-4ba6-a672-d57075a45bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:13.327856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-dd15b08c-742e-4ba6-a672-d57075a45bce None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:10:13.329086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dd15b08c-742e-4ba6-a672-d57075a45bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:13.337153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:10:13.373760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2ae9-750a-47e2-a944-455ab6bed264 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:10:13.375449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b05f2ae9-750a-47e2-a944-455ab6bed264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:13.389219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2ae9-750a-47e2-a944-455ab6bed264 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:10:13.392744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e72bb-2d66-4143-9d1a-fb17a6d4cf15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:10:13.393380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e72bb-2d66-4143-9d1a-fb17a6d4cf15 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:13.393663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e72bb-2d66-4143-9d1a-fb17a6d4cf15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:13.393941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e72bb-2d66-4143-9d1a-fb17a6d4cf15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:13.402783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e72bb-2d66-4143-9d1a-fb17a6d4cf15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:10:13.404223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e72bb-2d66-4143-9d1a-fb17a6d4cf15 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:10:13.413531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 760/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:10:16.863778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa78323-d5d4-49ca-bce7-6f6299dfcb45 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:16.864357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa78323-d5d4-49ca-bce7-6f6299dfcb45 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:16.864357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa78323-d5d4-49ca-bce7-6f6299dfcb45 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:16.865660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:10:16.871422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7faa9-789f-4b67-b936-e666a5e7f1b5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:16.871942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7faa9-789f-4b67-b936-e666a5e7f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:16.872226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7faa9-789f-4b67-b936-e666a5e7f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:16.889943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-82f7faa9-789f-4b67-b936-e666a5e7f1b5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:10:16.891126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-82f7faa9-789f-4b67-b936-e666a5e7f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:16.898830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:10:17.212001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa78323-d5d4-49ca-bce7-6f6299dfcb45 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:10:17.213664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ffa78323-d5d4-49ca-bce7-6f6299dfcb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:17.291539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa78323-d5d4-49ca-bce7-6f6299dfcb45 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:10:17.295176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a6f5c-b4bb-4cc2-9de6-bd06202f1424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:10:17.295814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6f5c-b4bb-4cc2-9de6-bd06202f1424 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:17.296124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6f5c-b4bb-4cc2-9de6-bd06202f1424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:17.296401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6f5c-b4bb-4cc2-9de6-bd06202f1424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:17.305182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a6f5c-b4bb-4cc2-9de6-bd06202f1424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:10:17.306592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a6f5c-b4bb-4cc2-9de6-bd06202f1424 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:10:17.316090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 775/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:10:19.357186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3787-230d-43cc-b84d-f3c1c9f811ba None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:19.357767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3787-230d-43cc-b84d-f3c1c9f811ba None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:19.357767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3787-230d-43cc-b84d-f3c1c9f811ba None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:19.359124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 22:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:10:19.364306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232eca-ae0b-4671-979c-b37d8bf7776f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:19.364738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232eca-ae0b-4671-979c-b37d8bf7776f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:19.364833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232eca-ae0b-4671-979c-b37d8bf7776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:19.383222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0f232eca-ae0b-4671-979c-b37d8bf7776f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:10:19.384477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0f232eca-ae0b-4671-979c-b37d8bf7776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:19.393110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:10:19.689117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3787-230d-43cc-b84d-f3c1c9f811ba None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:10:19.690783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-375e3787-230d-43cc-b84d-f3c1c9f811ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:10:19.704335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3787-230d-43cc-b84d-f3c1c9f811ba None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:10:19.707778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f62ae-0ab3-4ad7-ab30-8e4158f82b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:10:19.708444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f62ae-0ab3-4ad7-ab30-8e4158f82b2a service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:10:19.708729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f62ae-0ab3-4ad7-ab30-8e4158f82b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:10:19.709005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f62ae-0ab3-4ad7-ab30-8e4158f82b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:10:19.718997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f62ae-0ab3-4ad7-ab30-8e4158f82b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:10:19.720474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f62ae-0ab3-4ad7-ab30-8e4158f82b2a service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:10:19.730134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 763/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:10:29.378128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=63 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:10:29.725660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=37 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:52.179153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614a3ba-9470-43bf-bc7d-4fa6257158cc None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.180377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614a3ba-9470-43bf-bc7d-4fa6257158cc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.180377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614a3ba-9470-43bf-bc7d-4fa6257158cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.210858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f614a3ba-9470-43bf-bc7d-4fa6257158cc None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.212775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f614a3ba-9470-43bf-bc7d-4fa6257158cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.225441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 777/1540] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.234691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6d2a4-a41f-4c48-8420-7daf35e7cfac None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.235273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6d2a4-a41f-4c48-8420-7daf35e7cfac None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.236157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6d2a4-a41f-4c48-8420-7daf35e7cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.258845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b3c6d2a4-a41f-4c48-8420-7daf35e7cfac None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.260104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b3c6d2a4-a41f-4c48-8420-7daf35e7cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.273278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 764/1541] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.278650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614a3ba-9470-43bf-bc7d-4fa6257158cc None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.289898 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614a3ba-9470-43bf-bc7d-4fa6257158cc None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.298959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73368b-747a-4c94-a90e-3ea3b210cb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.299642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73368b-747a-4c94-a90e-3ea3b210cb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.299942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73368b-747a-4c94-a90e-3ea3b210cb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.300227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73368b-747a-4c94-a90e-3ea3b210cb87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.300969 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73368b-747a-4c94-a90e-3ea3b210cb87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:11:52.301273 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73368b-747a-4c94-a90e-3ea3b210cb87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.302904 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73368b-747a-4c94-a90e-3ea3b210cb87 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.318296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 778/1542] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:11:52.326933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6d2a4-a41f-4c48-8420-7daf35e7cfac None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.333441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a25a-b0c2-4129-bf45-14c8d3bed963 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.333788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a25a-b0c2-4129-bf45-14c8d3bed963 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.334003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a25a-b0c2-4129-bf45-14c8d3bed963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.341049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6d2a4-a41f-4c48-8420-7daf35e7cfac None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.351164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb329b-ce53-4b5f-8932-0dd6dbb5f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.353182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb329b-ce53-4b5f-8932-0dd6dbb5f6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.353698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb329b-ce53-4b5f-8932-0dd6dbb5f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.354228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb329b-ce53-4b5f-8932-0dd6dbb5f6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.355155 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb329b-ce53-4b5f-8932-0dd6dbb5f6f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.361871 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb329b-ce53-4b5f-8932-0dd6dbb5f6f0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.367077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-95d3a25a-b0c2-4129-bf45-14c8d3bed963 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.368481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-95d3a25a-b0c2-4129-bf45-14c8d3bed963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.385414 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 779/1543] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.386727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70300de-5fc2-4533-94a6-b87bed09b612 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.387018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70300de-5fc2-4533-94a6-b87bed09b612 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.387297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70300de-5fc2-4533-94a6-b87bed09b612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.419677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b70300de-5fc2-4533-94a6-b87bed09b612 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.420927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b70300de-5fc2-4533-94a6-b87bed09b612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.432260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 780/1544] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.437611 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73c212-9006-4411-b332-b70c71eb5964 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.437900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73c212-9006-4411-b332-b70c71eb5964 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.438233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73c212-9006-4411-b332-b70c71eb5964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.449496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 765/1545] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:52.450824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f437c-2981-40cd-8bb3-f84e0a96605d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.451120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f437c-2981-40cd-8bb3-f84e0a96605d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.451462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f437c-2981-40cd-8bb3-f84e0a96605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.463301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ac73c212-9006-4411-b332-b70c71eb5964 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.464903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ac73c212-9006-4411-b332-b70c71eb5964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.495271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ac2f437c-2981-40cd-8bb3-f84e0a96605d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.496533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ac2f437c-2981-40cd-8bb3-f84e0a96605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.545246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 781/1546] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.547033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90003c-a424-416a-bcda-0b3bf2d9b356 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.547526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90003c-a424-416a-bcda-0b3bf2d9b356 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.548031 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90003c-a424-416a-bcda-0b3bf2d9b356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.572062 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ec90003c-a424-416a-bcda-0b3bf2d9b356 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.573615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec90003c-a424-416a-bcda-0b3bf2d9b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.588959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 782/1547] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.590732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90003c-a424-416a-bcda-0b3bf2d9b356 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.603543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90003c-a424-416a-bcda-0b3bf2d9b356 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.608409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd080eb-162f-45fa-952f-6971aaadda9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.608994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd080eb-162f-45fa-952f-6971aaadda9a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.609278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd080eb-162f-45fa-952f-6971aaadda9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.609554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd080eb-162f-45fa-952f-6971aaadda9a admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.610244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd080eb-162f-45fa-952f-6971aaadda9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.613087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd080eb-162f-45fa-952f-6971aaadda9a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.624712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 766/1548] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.626448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99d7bc-385f-42ee-9158-14ea998fb9e5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.626768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99d7bc-385f-42ee-9158-14ea998fb9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.627057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99d7bc-385f-42ee-9158-14ea998fb9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.638902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 783/1549] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:52.640208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd080eb-162f-45fa-952f-6971aaadda9a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.652186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd080eb-162f-45fa-952f-6971aaadda9a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.653406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4f99d7bc-385f-42ee-9158-14ea998fb9e5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.654617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4f99d7bc-385f-42ee-9158-14ea998fb9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.657692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249dd29-2346-4f58-8f90-d8d168ac0f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.658470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249dd29-2346-4f58-8f90-d8d168ac0f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.658715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249dd29-2346-4f58-8f90-d8d168ac0f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.658986 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249dd29-2346-4f58-8f90-d8d168ac0f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.659711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249dd29-2346-4f58-8f90-d8d168ac0f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:11:52.660055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249dd29-2346-4f58-8f90-d8d168ac0f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.661640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249dd29-2346-4f58-8f90-d8d168ac0f2a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.663661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 767/1550] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.665154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99d7bc-385f-42ee-9158-14ea998fb9e5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.674852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 784/1551] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:11:52.675538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99d7bc-385f-42ee-9158-14ea998fb9e5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.676148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570d3b-6de6-467a-a5da-4f6c1247181a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.676431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570d3b-6de6-467a-a5da-4f6c1247181a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.676714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570d3b-6de6-467a-a5da-4f6c1247181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.680764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8424c82-80c7-4af2-8f2c-b28ba1c0c8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.681435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8424c82-80c7-4af2-8f2c-b28ba1c0c8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.681723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8424c82-80c7-4af2-8f2c-b28ba1c0c8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.682006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8424c82-80c7-4af2-8f2c-b28ba1c0c8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.682736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8424c82-80c7-4af2-8f2c-b28ba1c0c8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:11:52.683049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8424c82-80c7-4af2-8f2c-b28ba1c0c8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.684209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-f8424c82-80c7-4af2-8f2c-b28ba1c0c8aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:11:52.684209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 13 22:11:52.684209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: Jul 13 22:11:52.685123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8424c82-80c7-4af2-8f2c-b28ba1c0c8aa admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.695493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7e570d3b-6de6-467a-a5da-4f6c1247181a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.697034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7e570d3b-6de6-467a-a5da-4f6c1247181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.697539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 768/1552] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:11:52.698885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44be729-4a52-4689-998b-70db5c8ecc71 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.699178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44be729-4a52-4689-998b-70db5c8ecc71 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.699459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44be729-4a52-4689-998b-70db5c8ecc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.705038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 785/1553] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.705794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e570d3b-6de6-467a-a5da-4f6c1247181a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.715983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e570d3b-6de6-467a-a5da-4f6c1247181a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.718195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e44be729-4a52-4689-998b-70db5c8ecc71 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.719429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e44be729-4a52-4689-998b-70db5c8ecc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.720870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450d6ae-cbb2-46c1-aab8-e2502c099f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.721595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450d6ae-cbb2-46c1-aab8-e2502c099f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.721880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450d6ae-cbb2-46c1-aab8-e2502c099f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.722156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450d6ae-cbb2-46c1-aab8-e2502c099f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.722886 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450d6ae-cbb2-46c1-aab8-e2502c099f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.724502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450d6ae-cbb2-46c1-aab8-e2502c099f70 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.728409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 769/1554] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.729655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06bc09-0fc1-400f-bf2c-790ec3f19b30 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.729948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06bc09-0fc1-400f-bf2c-790ec3f19b30 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.730228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06bc09-0fc1-400f-bf2c-790ec3f19b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.737191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 786/1555] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:52.738757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11882d2d-ad1a-4ec5-abe2-f0c83cdaa9fd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.739199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11882d2d-ad1a-4ec5-abe2-f0c83cdaa9fd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.739481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11882d2d-ad1a-4ec5-abe2-f0c83cdaa9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.748640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1b06bc09-0fc1-400f-bf2c-790ec3f19b30 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.749848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1b06bc09-0fc1-400f-bf2c-790ec3f19b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.757549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-11882d2d-ad1a-4ec5-abe2-f0c83cdaa9fd None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.758178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 770/1556] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.759160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-11882d2d-ad1a-4ec5-abe2-f0c83cdaa9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.762678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf599c6-8343-47fd-8ae9-4d123dde2597 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.763071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf599c6-8343-47fd-8ae9-4d123dde2597 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.763455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf599c6-8343-47fd-8ae9-4d123dde2597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.767417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 787/1557] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.768298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11882d2d-ad1a-4ec5-abe2-f0c83cdaa9fd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.779503 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11882d2d-ad1a-4ec5-abe2-f0c83cdaa9fd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.782773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4cf599c6-8343-47fd-8ae9-4d123dde2597 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.784006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4cf599c6-8343-47fd-8ae9-4d123dde2597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.784153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af6282-7ec4-4833-bec2-782a30c860cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.784830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af6282-7ec4-4833-bec2-782a30c860cd admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.785116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af6282-7ec4-4833-bec2-782a30c860cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.785391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af6282-7ec4-4833-bec2-782a30c860cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.786073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af6282-7ec4-4833-bec2-782a30c860cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.787085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-c6af6282-7ec4-4833-bec2-782a30c860cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:11:52.787085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 13 22:11:52.787085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: Jul 13 22:11:52.788294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af6282-7ec4-4833-bec2-782a30c860cd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.793390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 771/1558] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.796705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf599c6-8343-47fd-8ae9-4d123dde2597 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.807053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf599c6-8343-47fd-8ae9-4d123dde2597 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.811832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf850d76-96eb-47a7-b4c5-76a8f1dd1918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.812522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf850d76-96eb-47a7-b4c5-76a8f1dd1918 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.812811 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf850d76-96eb-47a7-b4c5-76a8f1dd1918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.813112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf850d76-96eb-47a7-b4c5-76a8f1dd1918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.813804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf850d76-96eb-47a7-b4c5-76a8f1dd1918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.814369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 788/1559] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:52.815684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf850d76-96eb-47a7-b4c5-76a8f1dd1918 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.815797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788521-3ec8-46fd-9671-cbb73be58775 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.816012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788521-3ec8-46fd-9671-cbb73be58775 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.816289 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788521-3ec8-46fd-9671-cbb73be58775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.838165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2b788521-3ec8-46fd-9671-cbb73be58775 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.839555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2b788521-3ec8-46fd-9671-cbb73be58775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.846669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 772/1560] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:52.846669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf850d76-96eb-47a7-b4c5-76a8f1dd1918 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.886398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:52.906453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 789/1561] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.908785 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b788521-3ec8-46fd-9671-cbb73be58775 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.914915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf850d76-96eb-47a7-b4c5-76a8f1dd1918 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.919032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b788521-3ec8-46fd-9671-cbb73be58775 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.919930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20bf72-6fd0-4220-b685-d7d8aa591e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.920591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20bf72-6fd0-4220-b685-d7d8aa591e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.920871 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20bf72-6fd0-4220-b685-d7d8aa591e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.921149 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20bf72-6fd0-4220-b685-d7d8aa591e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.921872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20bf72-6fd0-4220-b685-d7d8aa591e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:11:52.922176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20bf72-6fd0-4220-b685-d7d8aa591e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.923749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20bf72-6fd0-4220-b685-d7d8aa591e1f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.924295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aec43e-390d-400a-9f68-5aaa8c6c850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.924954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aec43e-390d-400a-9f68-5aaa8c6c850f admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.925243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aec43e-390d-400a-9f68-5aaa8c6c850f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.925522 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aec43e-390d-400a-9f68-5aaa8c6c850f admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.926284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aec43e-390d-400a-9f68-5aaa8c6c850f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.926430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:52.927872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aec43e-390d-400a-9f68-5aaa8c6c850f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.937160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 773/1562] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:11:52.938660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608188-28bf-48b4-b653-98ba37e7bcfd None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.939128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608188-28bf-48b4-b653-98ba37e7bcfd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.939261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 790/1563] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:52.939665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608188-28bf-48b4-b653-98ba37e7bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.940488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e95497-d162-41c5-a8f3-af1efc1ed366 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.940780 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e95497-d162-41c5-a8f3-af1efc1ed366 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.941062 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e95497-d162-41c5-a8f3-af1efc1ed366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.958933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9b608188-28bf-48b4-b653-98ba37e7bcfd None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.960429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9b608188-28bf-48b4-b653-98ba37e7bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.961780 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-15e95497-d162-41c5-a8f3-af1efc1ed366 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:52.963128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-15e95497-d162-41c5-a8f3-af1efc1ed366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:52.969589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 774/1564] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.970363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608188-28bf-48b4-b653-98ba37e7bcfd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.971264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 791/1565] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:52.972130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e95497-d162-41c5-a8f3-af1efc1ed366 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:52.982318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e95497-d162-41c5-a8f3-af1efc1ed366 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.983422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608188-28bf-48b4-b653-98ba37e7bcfd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:52.986852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5622-aa33-47e6-aedf-09c80038b300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.987505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5622-aa33-47e6-aedf-09c80038b300 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.987792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5622-aa33-47e6-aedf-09c80038b300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.987944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda9db5-e22a-4218-ae11-9911b3a7b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:52.988121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5622-aa33-47e6-aedf-09c80038b300 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.988588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda9db5-e22a-4218-ae11-9911b3a7b947 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:52.988786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e5622-aa33-47e6-aedf-09c80038b300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.988887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda9db5-e22a-4218-ae11-9911b3a7b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:52.989133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda9db5-e22a-4218-ae11-9911b3a7b947 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:52.989861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda9db5-e22a-4218-ae11-9911b3a7b947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:11:52.990165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda9db5-e22a-4218-ae11-9911b3a7b947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:52.990688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e5622-aa33-47e6-aedf-09c80038b300 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:52.991721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda9db5-e22a-4218-ae11-9911b3a7b947 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.003880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 775/1566] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:11:53.004696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda9db5-e22a-4218-ae11-9911b3a7b947 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.014870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda9db5-e22a-4218-ae11-9911b3a7b947 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.015756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 792/1567] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:11:52 2022] POST /identity/v3/users => generated 303 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.016715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5622-aa33-47e6-aedf-09c80038b300 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.021554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d053-6339-47bc-9f6b-c00e717e6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.022207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d053-6339-47bc-9f6b-c00e717e6a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.022491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d053-6339-47bc-9f6b-c00e717e6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.022766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d053-6339-47bc-9f6b-c00e717e6a3e admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.023454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d053-6339-47bc-9f6b-c00e717e6a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.025236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-1143d053-6339-47bc-9f6b-c00e717e6a3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:11:53.025236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 13 22:11:53.025236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: Jul 13 22:11:53.026436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d053-6339-47bc-9f6b-c00e717e6a3e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.028617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5622-aa33-47e6-aedf-09c80038b300 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.033202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8cc9d-b2b5-4fea-a1d1-c87427aeb811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.033858 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8cc9d-b2b5-4fea-a1d1-c87427aeb811 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.034153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8cc9d-b2b5-4fea-a1d1-c87427aeb811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.034433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8cc9d-b2b5-4fea-a1d1-c87427aeb811 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.035498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8cc9d-b2b5-4fea-a1d1-c87427aeb811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:11:53.035498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8cc9d-b2b5-4fea-a1d1-c87427aeb811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.037068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8cc9d-b2b5-4fea-a1d1-c87427aeb811 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.048298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 776/1568] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.049172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d053-6339-47bc-9f6b-c00e717e6a3e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.053148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 793/1569] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:11:53.053816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8cc9d-b2b5-4fea-a1d1-c87427aeb811 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.063619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8cc9d-b2b5-4fea-a1d1-c87427aeb811 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.065178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d053-6339-47bc-9f6b-c00e717e6a3e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.068245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85834fa4-0bfe-4c43-a398-ea9cbad7f37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.068924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85834fa4-0bfe-4c43-a398-ea9cbad7f37a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.069215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85834fa4-0bfe-4c43-a398-ea9cbad7f37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.069568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85834fa4-0bfe-4c43-a398-ea9cbad7f37a admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.069805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8613df-dce1-4dce-9a7e-43cfd1e5a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.070186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85834fa4-0bfe-4c43-a398-ea9cbad7f37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.071047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8613df-dce1-4dce-9a7e-43cfd1e5a5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.071335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8613df-dce1-4dce-9a7e-43cfd1e5a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.071618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8613df-dce1-4dce-9a7e-43cfd1e5a5c6 admin admin] PATH_INFO: `/v3/projects/fc5a6c97a38c4e28908047a28e066d25/users/bb4c7ad91bc449f9910d4c4d0327ba71/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.072196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85834fa4-0bfe-4c43-a398-ea9cbad7f37a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.087351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8613df-dce1-4dce-9a7e-43cfd1e5a5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5a6c97a38c4e28908047a28e066d25, user_id=bb4c7ad91bc449f9910d4c4d0327ba71, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.090035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8613df-dce1-4dce-9a7e-43cfd1e5a5c6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.098768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 794/1570] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.099660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85834fa4-0bfe-4c43-a398-ea9cbad7f37a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.104036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 777/1571] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:53 2022] PUT /identity/v3/projects/fc5a6c97a38c4e28908047a28e066d25/users/bb4c7ad91bc449f9910d4c4d0327ba71/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:53.104868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8613df-dce1-4dce-9a7e-43cfd1e5a5c6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.171783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85834fa4-0bfe-4c43-a398-ea9cbad7f37a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.173944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8613df-dce1-4dce-9a7e-43cfd1e5a5c6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.176552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469f024-27f1-4536-b28a-48d722e908eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.177219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f024-27f1-4536-b28a-48d722e908eb admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.177510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f024-27f1-4536-b28a-48d722e908eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.177793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f024-27f1-4536-b28a-48d722e908eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.178553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469f024-27f1-4536-b28a-48d722e908eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:11:53.178691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd13955-afc5-4f2b-a1e7-4f90aa78f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.178883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469f024-27f1-4536-b28a-48d722e908eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.179339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13955-afc5-4f2b-a1e7-4f90aa78f751 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.179624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13955-afc5-4f2b-a1e7-4f90aa78f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.179943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13955-afc5-4f2b-a1e7-4f90aa78f751 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.180541 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469f024-27f1-4536-b28a-48d722e908eb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.180982 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd13955-afc5-4f2b-a1e7-4f90aa78f751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:11:53.181063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd13955-afc5-4f2b-a1e7-4f90aa78f751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.182607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd13955-afc5-4f2b-a1e7-4f90aa78f751 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.192403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 795/1572] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:11:53.193201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469f024-27f1-4536-b28a-48d722e908eb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.201647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 778/1573] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:11:53.201647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd13955-afc5-4f2b-a1e7-4f90aa78f751 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.204237 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469f024-27f1-4536-b28a-48d722e908eb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.208892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cf99e-ae6b-4b83-9581-67d01638f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.209816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf99e-ae6b-4b83-9581-67d01638f81b admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.210108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf99e-ae6b-4b83-9581-67d01638f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.210398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf99e-ae6b-4b83-9581-67d01638f81b admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.211836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cf99e-ae6b-4b83-9581-67d01638f81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.211978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd13955-afc5-4f2b-a1e7-4f90aa78f751 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.213911 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cf99e-ae6b-4b83-9581-67d01638f81b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.216451 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b86fd6-00ca-41e0-a16c-dc406d64d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.217294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b86fd6-00ca-41e0-a16c-dc406d64d338 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.217420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b86fd6-00ca-41e0-a16c-dc406d64d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.217663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b86fd6-00ca-41e0-a16c-dc406d64d338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.218398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b86fd6-00ca-41e0-a16c-dc406d64d338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.220012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b86fd6-00ca-41e0-a16c-dc406d64d338 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.230909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 779/1574] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:53.232056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b86fd6-00ca-41e0-a16c-dc406d64d338 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.242005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 796/1575] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.243233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cf99e-ae6b-4b83-9581-67d01638f81b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.243790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b86fd6-00ca-41e0-a16c-dc406d64d338 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.292632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:53.302359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875b7b5-3d57-4792-a352-ee89c1b5496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.303034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875b7b5-3d57-4792-a352-ee89c1b5496c admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.303317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875b7b5-3d57-4792-a352-ee89c1b5496c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.303591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875b7b5-3d57-4792-a352-ee89c1b5496c admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.304343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875b7b5-3d57-4792-a352-ee89c1b5496c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.305991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875b7b5-3d57-4792-a352-ee89c1b5496c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.307567 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cf99e-ae6b-4b83-9581-67d01638f81b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.312228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde724fa-f759-403c-b8d8-68ad9fd47465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.312887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde724fa-f759-403c-b8d8-68ad9fd47465 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.313173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde724fa-f759-403c-b8d8-68ad9fd47465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.313454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde724fa-f759-403c-b8d8-68ad9fd47465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.314175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde724fa-f759-403c-b8d8-68ad9fd47465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.315662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 780/1576] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:53.316094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde724fa-f759-403c-b8d8-68ad9fd47465 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.316542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875b7b5-3d57-4792-a352-ee89c1b5496c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.326782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875b7b5-3d57-4792-a352-ee89c1b5496c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.331606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9dd3e-5679-4505-9664-829b3a3d3198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.332298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9dd3e-5679-4505-9664-829b3a3d3198 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.332588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9dd3e-5679-4505-9664-829b3a3d3198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.332866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9dd3e-5679-4505-9664-829b3a3d3198 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.333625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9dd3e-5679-4505-9664-829b3a3d3198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.336400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9dd3e-5679-4505-9664-829b3a3d3198 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.347583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 797/1577] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.347583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9a833-7b35-49fc-8da8-78bead6a15a7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.347583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9a833-7b35-49fc-8da8-78bead6a15a7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.347583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9a833-7b35-49fc-8da8-78bead6a15a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.349441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:53.361094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 781/1578] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.364416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9dd3e-5679-4505-9664-829b3a3d3198 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.370377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c5f9a833-7b35-49fc-8da8-78bead6a15a7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:53.371455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c5f9a833-7b35-49fc-8da8-78bead6a15a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:53.372866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9dd3e-5679-4505-9664-829b3a3d3198 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.429353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2692b-6937-46b4-ab77-a635da8873e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.430686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 798/1579] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:53.434190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2692b-6937-46b4-ab77-a635da8873e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.434190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2692b-6937-46b4-ab77-a635da8873e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.434190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2692b-6937-46b4-ab77-a635da8873e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.434437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9a833-7b35-49fc-8da8-78bead6a15a7 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.435035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2692b-6937-46b4-ab77-a635da8873e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.435035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2692b-6937-46b4-ab77-a635da8873e2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.441069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9a833-7b35-49fc-8da8-78bead6a15a7 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.446726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a59fe-7c91-4c0f-832e-006cdb2ba0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.447390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a59fe-7c91-4c0f-832e-006cdb2ba0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.447674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a59fe-7c91-4c0f-832e-006cdb2ba0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.447980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a59fe-7c91-4c0f-832e-006cdb2ba0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.448673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a59fe-7c91-4c0f-832e-006cdb2ba0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.450574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a59fe-7c91-4c0f-832e-006cdb2ba0c9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.464803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 782/1580] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.464803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2692b-6937-46b4-ab77-a635da8873e2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.481862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 799/1581] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.482758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a59fe-7c91-4c0f-832e-006cdb2ba0c9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.528169 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2692b-6937-46b4-ab77-a635da8873e2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.545722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a59fe-7c91-4c0f-832e-006cdb2ba0c9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.550455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6fff-0355-480e-a9ab-51b605c1c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.551121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6fff-0355-480e-a9ab-51b605c1c2bb admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.551408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6fff-0355-480e-a9ab-51b605c1c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.551684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6fff-0355-480e-a9ab-51b605c1c2bb admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.552411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a6fff-0355-480e-a9ab-51b605c1c2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.554344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a6fff-0355-480e-a9ab-51b605c1c2bb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.575661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 800/1582] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.576516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6fff-0355-480e-a9ab-51b605c1c2bb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.586491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6fff-0355-480e-a9ab-51b605c1c2bb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.587889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eba01-6ea7-48e9-9a79-1dfff98bda3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.588596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eba01-6ea7-48e9-9a79-1dfff98bda3d admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.588926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eba01-6ea7-48e9-9a79-1dfff98bda3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.589194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eba01-6ea7-48e9-9a79-1dfff98bda3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.589935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eba01-6ea7-48e9-9a79-1dfff98bda3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.591309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e54f7-8dd2-4fed-8a2f-f52ed2f2f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.591568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eba01-6ea7-48e9-9a79-1dfff98bda3d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.591975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e54f7-8dd2-4fed-8a2f-f52ed2f2f814 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.592264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e54f7-8dd2-4fed-8a2f-f52ed2f2f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.592544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e54f7-8dd2-4fed-8a2f-f52ed2f2f814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.593268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e54f7-8dd2-4fed-8a2f-f52ed2f2f814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.594862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e54f7-8dd2-4fed-8a2f-f52ed2f2f814 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.602745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 783/1583] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:53.603377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eba01-6ea7-48e9-9a79-1dfff98bda3d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.609149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 801/1584] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:53.610144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e54f7-8dd2-4fed-8a2f-f52ed2f2f814 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.616166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eba01-6ea7-48e9-9a79-1dfff98bda3d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.620505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e54f7-8dd2-4fed-8a2f-f52ed2f2f814 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.621285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af920b3a-0543-4c4a-97cd-26335d8885f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.621961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af920b3a-0543-4c4a-97cd-26335d8885f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.622249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af920b3a-0543-4c4a-97cd-26335d8885f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.622531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af920b3a-0543-4c4a-97cd-26335d8885f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.623247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af920b3a-0543-4c4a-97cd-26335d8885f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.625172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af920b3a-0543-4c4a-97cd-26335d8885f3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.630856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91971-d217-487d-910b-ed5a1eba8d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.631517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91971-d217-487d-910b-ed5a1eba8d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.631802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91971-d217-487d-910b-ed5a1eba8d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.632110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91971-d217-487d-910b-ed5a1eba8d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.632945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c91971-d217-487d-910b-ed5a1eba8d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.634540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c91971-d217-487d-910b-ed5a1eba8d01 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.645740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 802/1585] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:53.649447 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 784/1586] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.649560 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91971-d217-487d-910b-ed5a1eba8d01 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.649676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af920b3a-0543-4c4a-97cd-26335d8885f3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.663950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af920b3a-0543-4c4a-97cd-26335d8885f3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.670724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e75d-5439-43c1-89e8-a4af0de08acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.671456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e75d-5439-43c1-89e8-a4af0de08acb admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.671798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e75d-5439-43c1-89e8-a4af0de08acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.672162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e75d-5439-43c1-89e8-a4af0de08acb admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.672938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6e75d-5439-43c1-89e8-a4af0de08acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.675331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6e75d-5439-43c1-89e8-a4af0de08acb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.675455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:53.682587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:53.697643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 785/1587] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.700844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e75d-5439-43c1-89e8-a4af0de08acb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.708065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e75d-5439-43c1-89e8-a4af0de08acb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.713358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3db773-1dc6-4a2e-bb10-1dff122b3aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.714001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3db773-1dc6-4a2e-bb10-1dff122b3aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.714289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3db773-1dc6-4a2e-bb10-1dff122b3aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.714566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3db773-1dc6-4a2e-bb10-1dff122b3aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.715244 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3db773-1dc6-4a2e-bb10-1dff122b3aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.716689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91971-d217-487d-910b-ed5a1eba8d01 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.717156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3db773-1dc6-4a2e-bb10-1dff122b3aa8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.720460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dff38-aad9-4a8f-8834-6350966d7490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.721101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dff38-aad9-4a8f-8834-6350966d7490 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.721387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dff38-aad9-4a8f-8834-6350966d7490 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.721667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dff38-aad9-4a8f-8834-6350966d7490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.734765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dff38-aad9-4a8f-8834-6350966d7490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.736233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dff38-aad9-4a8f-8834-6350966d7490 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.739216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 786/1588] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:11:53 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:53.740183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3db773-1dc6-4a2e-bb10-1dff122b3aa8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.748723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 803/1589] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:53.749706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dff38-aad9-4a8f-8834-6350966d7490 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.749856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3db773-1dc6-4a2e-bb10-1dff122b3aa8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.754655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7f796-899d-4f11-81f3-9f7824c5bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.755223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7f796-899d-4f11-81f3-9f7824c5bcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.755512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7f796-899d-4f11-81f3-9f7824c5bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.755808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7f796-899d-4f11-81f3-9f7824c5bcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.756567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7f796-899d-4f11-81f3-9f7824c5bcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.758340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7f796-899d-4f11-81f3-9f7824c5bcb0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.758900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dff38-aad9-4a8f-8834-6350966d7490 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.764490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed557d3e-546c-4133-aa32-34f2f6a8e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.765441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557d3e-546c-4133-aa32-34f2f6a8e443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.765933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557d3e-546c-4133-aa32-34f2f6a8e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.766281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557d3e-546c-4133-aa32-34f2f6a8e443 admin admin] PATH_INFO: `/v3/projects/012b831aaa6a400582bf2f3e2f56f211/users/cf3f0c17aea64751a6527b72e910abc3/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.769161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 787/1590] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:53.769964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7f796-899d-4f11-81f3-9f7824c5bcb0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.781749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7f796-899d-4f11-81f3-9f7824c5bcb0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.785423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed557d3e-546c-4133-aa32-34f2f6a8e443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012b831aaa6a400582bf2f3e2f56f211, user_id=cf3f0c17aea64751a6527b72e910abc3, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.786483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-ed557d3e-546c-4133-aa32-34f2f6a8e443 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:11:53.786483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 13 22:11:53.786483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: Jul 13 22:11:53.787706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d577b-5e58-4255-8bc1-98017c80c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.788746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed557d3e-546c-4133-aa32-34f2f6a8e443 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.788899 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d577b-5e58-4255-8bc1-98017c80c9da admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.789809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d577b-5e58-4255-8bc1-98017c80c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.790195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d577b-5e58-4255-8bc1-98017c80c9da admin admin] PATH_INFO: `/v3/projects/7a1e9ade3fe842d4993558cc3d255ada/users/966f641526b64cf3aec1744a141a2f56/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.805532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 804/1591] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:53 2022] PUT /identity/v3/projects/012b831aaa6a400582bf2f3e2f56f211/users/cf3f0c17aea64751a6527b72e910abc3/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:53.806453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed557d3e-546c-4133-aa32-34f2f6a8e443 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.810596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d577b-5e58-4255-8bc1-98017c80c9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1e9ade3fe842d4993558cc3d255ada, user_id=966f641526b64cf3aec1744a141a2f56, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.813486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d577b-5e58-4255-8bc1-98017c80c9da admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.828613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 788/1592] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:53 2022] PUT /identity/v3/projects/7a1e9ade3fe842d4993558cc3d255ada/users/966f641526b64cf3aec1744a141a2f56/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:53.829586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d577b-5e58-4255-8bc1-98017c80c9da admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.882444 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed557d3e-546c-4133-aa32-34f2f6a8e443 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.905438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d577b-5e58-4255-8bc1-98017c80c9da admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.910367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ebc30-e0a3-4a85-9801-a9272d0ce59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.911046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ebc30-e0a3-4a85-9801-a9272d0ce59d admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.911339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ebc30-e0a3-4a85-9801-a9272d0ce59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.911623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ebc30-e0a3-4a85-9801-a9272d0ce59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.912749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ebc30-e0a3-4a85-9801-a9272d0ce59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.914207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ebc30-e0a3-4a85-9801-a9272d0ce59d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.925891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 789/1593] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:53.929936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ebc30-e0a3-4a85-9801-a9272d0ce59d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.944987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ebc30-e0a3-4a85-9801-a9272d0ce59d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.957477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f13d8-1b7f-473b-8e27-00f7bf5540ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.959855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f13d8-1b7f-473b-8e27-00f7bf5540ec admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.960274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f13d8-1b7f-473b-8e27-00f7bf5540ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.960744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f13d8-1b7f-473b-8e27-00f7bf5540ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.962987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f13d8-1b7f-473b-8e27-00f7bf5540ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.964936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f13d8-1b7f-473b-8e27-00f7bf5540ec admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.976382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa4295-9d24-4d12-936d-198c7cd94e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.977965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa4295-9d24-4d12-936d-198c7cd94e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.978420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 790/1594] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:53.978586 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa4295-9d24-4d12-936d-198c7cd94e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.979924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f13d8-1b7f-473b-8e27-00f7bf5540ec admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.980480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa4295-9d24-4d12-936d-198c7cd94e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:53.981965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa4295-9d24-4d12-936d-198c7cd94e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:53.983767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa4295-9d24-4d12-936d-198c7cd94e54 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:53.991639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f13d8-1b7f-473b-8e27-00f7bf5540ec admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:53.994918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 805/1595] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:53.997838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9ee57-af80-4a29-bcf3-a615cf222825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:53.998448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9ee57-af80-4a29-bcf3-a615cf222825 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:53.998556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa4295-9d24-4d12-936d-198c7cd94e54 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:53.998850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9ee57-af80-4a29-bcf3-a615cf222825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:53.999208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9ee57-af80-4a29-bcf3-a615cf222825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.000166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9ee57-af80-4a29-bcf3-a615cf222825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.001754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9ee57-af80-4a29-bcf3-a615cf222825 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.009323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa4295-9d24-4d12-936d-198c7cd94e54 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.013895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 791/1596] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:54.014794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf935923-8153-42a2-be83-42e844f8700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.015236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec5d52-8cca-4e9d-b589-4bd337ea90e7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.015466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf935923-8153-42a2-be83-42e844f8700d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.015582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec5d52-8cca-4e9d-b589-4bd337ea90e7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.015794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec5d52-8cca-4e9d-b589-4bd337ea90e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.015932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf935923-8153-42a2-be83-42e844f8700d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.016324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf935923-8153-42a2-be83-42e844f8700d admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.017470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf935923-8153-42a2-be83-42e844f8700d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.019287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf935923-8153-42a2-be83-42e844f8700d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.031606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 806/1597] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:54.032960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850d0fe-6e0f-41fb-b0b0-6a03284ac4c9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.033252 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850d0fe-6e0f-41fb-b0b0-6a03284ac4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.033534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850d0fe-6e0f-41fb-b0b0-6a03284ac4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.034388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-57ec5d52-8cca-4e9d-b589-4bd337ea90e7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:54.035864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-57ec5d52-8cca-4e9d-b589-4bd337ea90e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:54.044767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 792/1598] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:54.045570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec5d52-8cca-4e9d-b589-4bd337ea90e7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.056352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec5d52-8cca-4e9d-b589-4bd337ea90e7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.060486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9850d0fe-6e0f-41fb-b0b0-6a03284ac4c9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:54.061394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930a92-27fe-425d-9d64-ced101796bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.062302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930a92-27fe-425d-9d64-ced101796bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.062587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930a92-27fe-425d-9d64-ced101796bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.062710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9850d0fe-6e0f-41fb-b0b0-6a03284ac4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:54.062887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930a92-27fe-425d-9d64-ced101796bd0 admin admin] PATH_INFO: `/v3/projects/73937088480045a6bac76f080910013d/users/3b2cddd038514f509f751d9a0917838b/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.073054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 807/1599] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:54.074579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850d0fe-6e0f-41fb-b0b0-6a03284ac4c9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.081511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f930a92-27fe-425d-9d64-ced101796bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73937088480045a6bac76f080910013d, user_id=3b2cddd038514f509f751d9a0917838b, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.084869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f930a92-27fe-425d-9d64-ced101796bd0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.086166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850d0fe-6e0f-41fb-b0b0-6a03284ac4c9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.092402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8e664-c00d-4400-b781-375639f8c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.093156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8e664-c00d-4400-b781-375639f8c0ce admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.093470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8e664-c00d-4400-b781-375639f8c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.093752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8e664-c00d-4400-b781-375639f8c0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.094634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8e664-c00d-4400-b781-375639f8c0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.096444 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8e664-c00d-4400-b781-375639f8c0ce admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.116086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 793/1600] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:54 2022] PUT /identity/v3/projects/73937088480045a6bac76f080910013d/users/3b2cddd038514f509f751d9a0917838b/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:54.116086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930a92-27fe-425d-9d64-ced101796bd0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.116432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 808/1601] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:54.116432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8e664-c00d-4400-b781-375639f8c0ce admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.123070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8e664-c00d-4400-b781-375639f8c0ce admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.134988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:54.156441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:54.186207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930a92-27fe-425d-9d64-ced101796bd0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.198444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7bb9c-2215-4b06-9bf2-7d9201abae3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.199556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7bb9c-2215-4b06-9bf2-7d9201abae3c admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.200028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7bb9c-2215-4b06-9bf2-7d9201abae3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.200458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7bb9c-2215-4b06-9bf2-7d9201abae3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.201737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7bb9c-2215-4b06-9bf2-7d9201abae3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.203599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7bb9c-2215-4b06-9bf2-7d9201abae3c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.218049 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80467742-8d9a-432d-b989-4bb6cbad30a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.218940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80467742-8d9a-432d-b989-4bb6cbad30a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.219374 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80467742-8d9a-432d-b989-4bb6cbad30a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.219554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 794/1602] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:54.220047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80467742-8d9a-432d-b989-4bb6cbad30a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.220487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7bb9c-2215-4b06-9bf2-7d9201abae3c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.221056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80467742-8d9a-432d-b989-4bb6cbad30a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.223293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80467742-8d9a-432d-b989-4bb6cbad30a6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.233436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7bb9c-2215-4b06-9bf2-7d9201abae3c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.239972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 809/1603] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:54.239972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80467742-8d9a-432d-b989-4bb6cbad30a6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.242786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b654a58-3cab-41f1-8adf-c0a05616aa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.243943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654a58-3cab-41f1-8adf-c0a05616aa1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.244535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654a58-3cab-41f1-8adf-c0a05616aa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.244535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654a58-3cab-41f1-8adf-c0a05616aa1c admin admin] PATH_INFO: `/v3/projects/efca2bda9b0943ceb7a0ac02ba93de4a/users/5ab554c1324a4524925126cf017de666/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.262220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b654a58-3cab-41f1-8adf-c0a05616aa1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efca2bda9b0943ceb7a0ac02ba93de4a, user_id=5ab554c1324a4524925126cf017de666, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.265077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b654a58-3cab-41f1-8adf-c0a05616aa1c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.285114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 795/1604] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:54 2022] PUT /identity/v3/projects/efca2bda9b0943ceb7a0ac02ba93de4a/users/5ab554c1324a4524925126cf017de666/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:54.296856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b654a58-3cab-41f1-8adf-c0a05616aa1c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.318611 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80467742-8d9a-432d-b989-4bb6cbad30a6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.359815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b654a58-3cab-41f1-8adf-c0a05616aa1c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.364029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35bc9a-3bdf-4489-aef3-46cefb0f6ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.364689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35bc9a-3bdf-4489-aef3-46cefb0f6ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.365002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35bc9a-3bdf-4489-aef3-46cefb0f6ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.365282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35bc9a-3bdf-4489-aef3-46cefb0f6ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.379746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbae812-309b-4ee2-8920-fe7f49d802bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.380478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbae812-309b-4ee2-8920-fe7f49d802bb service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.380761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbae812-309b-4ee2-8920-fe7f49d802bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.381096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbae812-309b-4ee2-8920-fe7f49d802bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.443213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35bc9a-3bdf-4489-aef3-46cefb0f6ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.445280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35bc9a-3bdf-4489-aef3-46cefb0f6ac3 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.454721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbae812-309b-4ee2-8920-fe7f49d802bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.456241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbae812-309b-4ee2-8920-fe7f49d802bb service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.464872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 796/1605] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:54.465265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35bc9a-3bdf-4489-aef3-46cefb0f6ac3 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.475820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 810/1606] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:54.476221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35bc9a-3bdf-4489-aef3-46cefb0f6ac3 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.480399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478079-4e7a-4e71-a0aa-6336b0378bfa None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.481779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478079-4e7a-4e71-a0aa-6336b0378bfa None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.482270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478079-4e7a-4e71-a0aa-6336b0378bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.482564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ec60-9a32-45fc-a528-8daf70ef9148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.483664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ec60-9a32-45fc-a528-8daf70ef9148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.483979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ec60-9a32-45fc-a528-8daf70ef9148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.484327 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ec60-9a32-45fc-a528-8daf70ef9148 admin admin] PATH_INFO: `/v3/projects/f23ed984bddd49f0904553ce84e5e8d8/users/e5a2ca1c3b1b43cd9c9fe090d2d41cbf/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.503260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536ec60-9a32-45fc-a528-8daf70ef9148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23ed984bddd49f0904553ce84e5e8d8, user_id=e5a2ca1c3b1b43cd9c9fe090d2d41cbf, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.510805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536ec60-9a32-45fc-a528-8daf70ef9148 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.511446 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:54.522077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-16478079-4e7a-4e71-a0aa-6336b0378bfa None None] MFA Rules not processed for user `3b2cddd038514f509f751d9a0917838b`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:54.524784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-16478079-4e7a-4e71-a0aa-6336b0378bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:54.539701 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 797/1607] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:54 2022] PUT /identity/v3/projects/f23ed984bddd49f0904553ce84e5e8d8/users/e5a2ca1c3b1b43cd9c9fe090d2d41cbf/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:54.541938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ec60-9a32-45fc-a528-8daf70ef9148 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.612147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:54.641019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 811/1608] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:54.643137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478079-4e7a-4e71-a0aa-6336b0378bfa None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:54.657886 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478079-4e7a-4e71-a0aa-6336b0378bfa None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.664078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ec60-9a32-45fc-a528-8daf70ef9148 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:54.665246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532650b-8026-4872-8672-45f3808b05cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.666759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532650b-8026-4872-8672-45f3808b05cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.667281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532650b-8026-4872-8672-45f3808b05cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.667702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532650b-8026-4872-8672-45f3808b05cf admin admin] PATH_INFO: `/v3/projects/ba1f09399f9e4692be9473ea7e87af6b/users/71516217b1714e84bda9e584c97e84b8/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.687197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfce70a-dba5-4771-8aab-6c0a35f097f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:54.689455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532650b-8026-4872-8672-45f3808b05cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1f09399f9e4692be9473ea7e87af6b, user_id=71516217b1714e84bda9e584c97e84b8, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.690839 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfce70a-dba5-4771-8aab-6c0a35f097f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.691320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfce70a-dba5-4771-8aab-6c0a35f097f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.692569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfce70a-dba5-4771-8aab-6c0a35f097f5 admin admin] PATH_INFO: `/v3/projects/9ca6bef8c7e8436aa243006148db1a2c/users/94f0e18923564b29a3f88ce167af788a/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.693192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532650b-8026-4872-8672-45f3808b05cf admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.725011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 812/1609] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:54 2022] PUT /identity/v3/projects/ba1f09399f9e4692be9473ea7e87af6b/users/71516217b1714e84bda9e584c97e84b8/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:54.728315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5f3b-ad1f-4815-8927-b562501f7ff2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.728607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5f3b-ad1f-4815-8927-b562501f7ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.730829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5f3b-ad1f-4815-8927-b562501f7ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.736361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfce70a-dba5-4771-8aab-6c0a35f097f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca6bef8c7e8436aa243006148db1a2c, user_id=94f0e18923564b29a3f88ce167af788a, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:54.744037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfce70a-dba5-4771-8aab-6c0a35f097f5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:54.777769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 798/1610] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:54 2022] PUT /identity/v3/projects/9ca6bef8c7e8436aa243006148db1a2c/users/94f0e18923564b29a3f88ce167af788a/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:54.778945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a2ea5f3b-ad1f-4815-8927-b562501f7ff2 None None] MFA Rules not processed for user `5ab554c1324a4524925126cf017de666`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:54.780319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a2ea5f3b-ad1f-4815-8927-b562501f7ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:54.797398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7abb74-6437-4b48-ab07-f0ae1f3eb1d9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.798489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7abb74-6437-4b48-ab07-f0ae1f3eb1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.798489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7abb74-6437-4b48-ab07-f0ae1f3eb1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.847434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-dd7abb74-6437-4b48-ab07-f0ae1f3eb1d9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:54.852013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-dd7abb74-6437-4b48-ab07-f0ae1f3eb1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:54.930429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 813/1611] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:54.932081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff215-87db-49d5-a997-536aefcea691 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.932775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff215-87db-49d5-a997-536aefcea691 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.933125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff215-87db-49d5-a997-536aefcea691 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.935250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 814/1612] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 13 22:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:11:54.937448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1810b-3ade-4a51-8963-89bd012daea8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:54.937616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1810b-3ade-4a51-8963-89bd012daea8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:54.937907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1810b-3ade-4a51-8963-89bd012daea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:54.966729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-99c1810b-3ade-4a51-8963-89bd012daea8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:54.968511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-99c1810b-3ade-4a51-8963-89bd012daea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:55.048964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 799/1613] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:55.050422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed24b2-88ea-4b32-976d-59dace4c0ef0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.050929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed24b2-88ea-4b32-976d-59dace4c0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.051308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed24b2-88ea-4b32-976d-59dace4c0ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:55.081144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 815/1614] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:55.082717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95c6a-d12d-4834-b639-fb229d87e757 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.083223 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95c6a-d12d-4834-b639-fb229d87e757 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.083792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95c6a-d12d-4834-b639-fb229d87e757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:55.105501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:55.121675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-93ed24b2-88ea-4b32-976d-59dace4c0ef0 None None] MFA Rules not processed for user `94f0e18923564b29a3f88ce167af788a`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:55.122919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-93ed24b2-88ea-4b32-976d-59dace4c0ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:55.134699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0ca95c6a-d12d-4834-b639-fb229d87e757 None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:55.136755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0ca95c6a-d12d-4834-b639-fb229d87e757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:55.267299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 800/1615] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:55.267299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd98f3-7770-4529-8852-fe85c32c84c5 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.267939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd98f3-7770-4529-8852-fe85c32c84c5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.267939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd98f3-7770-4529-8852-fe85c32c84c5 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:55.272894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 801/1616] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 13 22:11:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:11:55.279247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd98f3-7770-4529-8852-fe85c32c84c5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:55.292430 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 816/1617] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 13 22:11:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:55.293520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca95c6a-d12d-4834-b639-fb229d87e757 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:55.382927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd98f3-7770-4529-8852-fe85c32c84c5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:55.383332 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca95c6a-d12d-4834-b639-fb229d87e757 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:55.387744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d60c89-7891-455a-9f8e-02ee203c1a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:55.388297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125729-792e-4ef2-9b51-0e7cde7aa6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:55.388585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d60c89-7891-455a-9f8e-02ee203c1a02 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.388945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d60c89-7891-455a-9f8e-02ee203c1a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.389298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d60c89-7891-455a-9f8e-02ee203c1a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:55.389476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125729-792e-4ef2-9b51-0e7cde7aa6cf service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.389839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125729-792e-4ef2-9b51-0e7cde7aa6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.390200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125729-792e-4ef2-9b51-0e7cde7aa6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:55.397154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:55.406134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d60c89-7891-455a-9f8e-02ee203c1a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:55.407663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d60c89-7891-455a-9f8e-02ee203c1a02 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:55.408713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125729-792e-4ef2-9b51-0e7cde7aa6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:55.410261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125729-792e-4ef2-9b51-0e7cde7aa6cf service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:55.419765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 802/1618] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:55.421985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fd1cf-d03e-48d9-995d-aa458d110d71 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.422291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fd1cf-d03e-48d9-995d-aa458d110d71 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.423066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fd1cf-d03e-48d9-995d-aa458d110d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:55.447933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-199fd1cf-d03e-48d9-995d-aa458d110d71 None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:55.449207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-199fd1cf-d03e-48d9-995d-aa458d110d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:55.450352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 817/1619] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:55.451294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125729-792e-4ef2-9b51-0e7cde7aa6cf service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:55.469099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 803/1620] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 13 22:11:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:55.470071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fd1cf-d03e-48d9-995d-aa458d110d71 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:55.483459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125729-792e-4ef2-9b51-0e7cde7aa6cf service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:55.488094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fd1cf-d03e-48d9-995d-aa458d110d71 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:55.500511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cb389-3b41-4036-8b0d-d963697db3f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:55.501801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cb389-3b41-4036-8b0d-d963697db3f8 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.502071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cb389-3b41-4036-8b0d-d963697db3f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.502424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cb389-3b41-4036-8b0d-d963697db3f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:55.510628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d16eaf-396b-494a-a959-0cf044815f04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:55.511649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d16eaf-396b-494a-a959-0cf044815f04 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.512811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d16eaf-396b-494a-a959-0cf044815f04 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.513202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d16eaf-396b-494a-a959-0cf044815f04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:55.541197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cb389-3b41-4036-8b0d-d963697db3f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:55.543035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cb389-3b41-4036-8b0d-d963697db3f8 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:55.564002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 804/1621] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:55.754333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d16eaf-396b-494a-a959-0cf044815f04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:55.756621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d16eaf-396b-494a-a959-0cf044815f04 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:55.775502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 818/1622] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:55.954803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24e66b-0a9d-4e26-88ce-779691693d32 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.954803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24e66b-0a9d-4e26-88ce-779691693d32 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.954803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24e66b-0a9d-4e26-88ce-779691693d32 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:55.956103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 805/1623] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 13 22:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:11:55.963981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47706f-cbb2-46f5-9d50-a00b1f408fa9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:55.964312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47706f-cbb2-46f5-9d50-a00b1f408fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:55.964537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47706f-cbb2-46f5-9d50-a00b1f408fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:56.024383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8f47706f-cbb2-46f5-9d50-a00b1f408fa9 None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:56.024383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8f47706f-cbb2-46f5-9d50-a00b1f408fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:56.028778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 819/1624] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:11:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:56.051822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24e66b-0a9d-4e26-88ce-779691693d32 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:56.128615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47706f-cbb2-46f5-9d50-a00b1f408fa9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:56.147868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47706f-cbb2-46f5-9d50-a00b1f408fa9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:56.183070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fb93d-b81e-4a0a-8c51-6a0af8c54d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:56.191045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fb93d-b81e-4a0a-8c51-6a0af8c54d42 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:56.191330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fb93d-b81e-4a0a-8c51-6a0af8c54d42 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:56.191621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fb93d-b81e-4a0a-8c51-6a0af8c54d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:56.213961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fb93d-b81e-4a0a-8c51-6a0af8c54d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:56.217507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fb93d-b81e-4a0a-8c51-6a0af8c54d42 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:56.221347 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24e66b-0a9d-4e26-88ce-779691693d32 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:56.231701 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe064c-4569-4643-a855-451e51883b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:56.232532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe064c-4569-4643-a855-451e51883b80 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:56.232679 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe064c-4569-4643-a855-451e51883b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:56.232965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe064c-4569-4643-a855-451e51883b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:56.243271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 820/1625] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:56.251553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe064c-4569-4643-a855-451e51883b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:56.253026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe064c-4569-4643-a855-451e51883b80 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:56.266275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 806/1626] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:56.304444 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfea43-d5cd-4364-978a-abbc763e8879 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:56.305593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfea43-d5cd-4364-978a-abbc763e8879 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:56.306042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfea43-d5cd-4364-978a-abbc763e8879 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:56.307676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 821/1627] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 13 22:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:11:56.313959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935f6f1-51da-4d3d-bc11-bb9837b57b7a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:56.314519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935f6f1-51da-4d3d-bc11-bb9837b57b7a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:56.314519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935f6f1-51da-4d3d-bc11-bb9837b57b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:56.350806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2935f6f1-51da-4d3d-bc11-bb9837b57b7a None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:56.353620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2935f6f1-51da-4d3d-bc11-bb9837b57b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:56.373605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 807/1628] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:11:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:56.388154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfea43-d5cd-4364-978a-abbc763e8879 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:56.410680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfea43-d5cd-4364-978a-abbc763e8879 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:56.418017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc59cc2-1a53-4fd3-aef8-fc3ab6746140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:56.419472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc59cc2-1a53-4fd3-aef8-fc3ab6746140 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:56.421613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc59cc2-1a53-4fd3-aef8-fc3ab6746140 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:56.422348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc59cc2-1a53-4fd3-aef8-fc3ab6746140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:56.441618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:56.448751 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc59cc2-1a53-4fd3-aef8-fc3ab6746140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:56.452795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc59cc2-1a53-4fd3-aef8-fc3ab6746140 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:56.481329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 822/1629] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:11:57.003055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d437-0d60-4e17-97ed-fdb6c89361b8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:57.003441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d437-0d60-4e17-97ed-fdb6c89361b8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:57.003732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d437-0d60-4e17-97ed-fdb6c89361b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:57.073626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7656d437-0d60-4e17-97ed-fdb6c89361b8 None None] MFA Rules not processed for user `cf3f0c17aea64751a6527b72e910abc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:57.074322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7656d437-0d60-4e17-97ed-fdb6c89361b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:57.237475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 808/1630] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:57.243495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc59cc2-1a53-4fd3-aef8-fc3ab6746140 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:57.263436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc59cc2-1a53-4fd3-aef8-fc3ab6746140 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:57.276104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028f85a-14bd-406b-adf4-7452e8813f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:57.278360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028f85a-14bd-406b-adf4-7452e8813f28 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:57.279004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028f85a-14bd-406b-adf4-7452e8813f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:57.280220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028f85a-14bd-406b-adf4-7452e8813f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:57.281309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028f85a-14bd-406b-adf4-7452e8813f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:57.287400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028f85a-14bd-406b-adf4-7452e8813f28 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:57.384173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 823/1631] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:11:57 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:57.387861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d437-0d60-4e17-97ed-fdb6c89361b8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:57.409871 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d437-0d60-4e17-97ed-fdb6c89361b8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:57.580188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658f304-4300-4ef9-941e-a64ef2825f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:57.580979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658f304-4300-4ef9-941e-a64ef2825f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:57.581300 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658f304-4300-4ef9-941e-a64ef2825f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:57.581580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658f304-4300-4ef9-941e-a64ef2825f32 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:57.585144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658f304-4300-4ef9-941e-a64ef2825f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:57.591705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658f304-4300-4ef9-941e-a64ef2825f32 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:57.616404 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:11:57.670747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 809/1632] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:11:57 2022] POST /identity/v3/users => generated 308 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:11:57.670961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028f85a-14bd-406b-adf4-7452e8813f28 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:57.687428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028f85a-14bd-406b-adf4-7452e8813f28 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:57.694270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c245c-ebda-4f86-b777-c9fff80f7c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:57.695015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c245c-ebda-4f86-b777-c9fff80f7c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:57.695936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c245c-ebda-4f86-b777-c9fff80f7c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:57.695936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c245c-ebda-4f86-b777-c9fff80f7c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:57.696851 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c245c-ebda-4f86-b777-c9fff80f7c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:57.699731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c245c-ebda-4f86-b777-c9fff80f7c66 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:57.734014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 824/1633] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:11:57.738811 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658f304-4300-4ef9-941e-a64ef2825f32 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:57.819042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658f304-4300-4ef9-941e-a64ef2825f32 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:57.840719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dafc8-8239-43b5-9519-c2802e113c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:57.841651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dafc8-8239-43b5-9519-c2802e113c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:57.841952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dafc8-8239-43b5-9519-c2802e113c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:57.842526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dafc8-8239-43b5-9519-c2802e113c08 admin admin] PATH_INFO: `/v3/projects/b3bac4b795c84e1bb6ea8f838eeb3596/users/35e1226e11a7464a84676eba1b63c8ed/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:57.862220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dafc8-8239-43b5-9519-c2802e113c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bac4b795c84e1bb6ea8f838eeb3596, user_id=35e1226e11a7464a84676eba1b63c8ed, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:57.865215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dafc8-8239-43b5-9519-c2802e113c08 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:57.909536 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 810/1634] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:57 2022] PUT /identity/v3/projects/b3bac4b795c84e1bb6ea8f838eeb3596/users/35e1226e11a7464a84676eba1b63c8ed/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:57.913704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c245c-ebda-4f86-b777-c9fff80f7c66 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:57.930141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c245c-ebda-4f86-b777-c9fff80f7c66 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:58.079453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026dbb0-391b-4a4d-838e-d5b26a743786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:58.080172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026dbb0-391b-4a4d-838e-d5b26a743786 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:58.080458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026dbb0-391b-4a4d-838e-d5b26a743786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:58.080739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026dbb0-391b-4a4d-838e-d5b26a743786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:58.081479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026dbb0-391b-4a4d-838e-d5b26a743786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:58.083099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026dbb0-391b-4a4d-838e-d5b26a743786 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:58.116397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dafc8-8239-43b5-9519-c2802e113c08 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:58.116682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 825/1635] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:11:58.121477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026dbb0-391b-4a4d-838e-d5b26a743786 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:58.129778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dafc8-8239-43b5-9519-c2802e113c08 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:58.137435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026dbb0-391b-4a4d-838e-d5b26a743786 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:58.145375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:58.146970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d0eab-2fb7-490c-918f-d5a5b711a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:58.147127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:58.147127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:58.147282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0eab-2fb7-490c-918f-d5a5b711a475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:58.147282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0eab-2fb7-490c-918f-d5a5b711a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:58.147435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0eab-2fb7-490c-918f-d5a5b711a475 admin admin] PATH_INFO: `/v3/projects/b3bac4b795c84e1bb6ea8f838eeb3596/users/35e1226e11a7464a84676eba1b63c8ed/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:58.148016 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] PATH_INFO: `/v3/users/3b2cddd038514f509f751d9a0917838b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:58.152133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2cddd038514f509f751d9a0917838b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:58.156139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d0eab-2fb7-490c-918f-d5a5b711a475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bac4b795c84e1bb6ea8f838eeb3596, user_id=35e1226e11a7464a84676eba1b63c8ed, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:58.156634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:58.159581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d0eab-2fb7-490c-918f-d5a5b711a475 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:58.186989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 826/1636] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:11:58 2022] PUT /identity/v3/projects/b3bac4b795c84e1bb6ea8f838eeb3596/users/35e1226e11a7464a84676eba1b63c8ed/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:11:58.265844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2cddd038514f509f751d9a0917838b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:11:58.295315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2cddd038514f509f751d9a0917838b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:11:58.296101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2cddd038514f509f751d9a0917838b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:11:58.322131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2cddd038514f509f751d9a0917838b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:11:58.322928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2cddd038514f509f751d9a0917838b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:11:58.358527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 811/1637] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:11:58 2022] DELETE /identity/v3/users/3b2cddd038514f509f751d9a0917838b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:11:58.363498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dafc15-9ed8-4e5a-b6a7-791cbf03b866 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:58.364972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dafc15-9ed8-4e5a-b6a7-791cbf03b866 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:58.365541 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dafc15-9ed8-4e5a-b6a7-791cbf03b866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:58.408855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e1dafc15-9ed8-4e5a-b6a7-791cbf03b866 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:11:58.411159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e1dafc15-9ed8-4e5a-b6a7-791cbf03b866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:58.539612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 827/1638] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:11:58.559499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:58.561940 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:58.652529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455a96c-c1f7-4d1a-8655-da173058e01f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:58.656957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922b6a9-a283-4e2a-9fc6-36d707ff1025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:58.657772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922b6a9-a283-4e2a-9fc6-36d707ff1025 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:58.658158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922b6a9-a283-4e2a-9fc6-36d707ff1025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:58.658569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922b6a9-a283-4e2a-9fc6-36d707ff1025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:58.673124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922b6a9-a283-4e2a-9fc6-36d707ff1025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:58.675356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922b6a9-a283-4e2a-9fc6-36d707ff1025 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:11:58.691522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 812/1639] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:11:59.805658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dafc15-9ed8-4e5a-b6a7-791cbf03b866 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:11:59.808379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e1dafc15-9ed8-4e5a-b6a7-791cbf03b866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:11:59.866273 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dafc15-9ed8-4e5a-b6a7-791cbf03b866 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:11:59.879321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:11:59.881507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:11:59.882111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:11:59.882819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] PATH_INFO: `/v3/projects/73937088480045a6bac76f080910013d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:11:59.886730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73937088480045a6bac76f080910013d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:11:59.902673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:00.013868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:00.023694 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73937088480045a6bac76f080910013d', 'request_id': 'req-7ad5af83-b963-4740-b50f-65dbc354078e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:00.045209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73937088480045a6bac76f080910013d', 'request_id': 'req-7ad5af83-b963-4740-b50f-65dbc354078e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:00.072966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73937088480045a6bac76f080910013d', 'request_id': 'req-7ad5af83-b963-4740-b50f-65dbc354078e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:00.089669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] The token cache is being invalidate because project 73937088480045a6bac76f080910013d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:00.089976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:00.090669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7ad5af83-b963-4740-b50f-65dbc354078e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:00.092542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 828/1640] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:11:59 2022] DELETE /identity/v3/projects/73937088480045a6bac76f080910013d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:00.099461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0123-c627-4ee8-85f5-0e8031a167ae None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:00.100495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0123-c627-4ee8-85f5-0e8031a167ae None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:00.100976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0123-c627-4ee8-85f5-0e8031a167ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:00.152831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2c0a0123-c627-4ee8-85f5-0e8031a167ae None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:00.160213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2c0a0123-c627-4ee8-85f5-0e8031a167ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:00.205314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:00.243776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 813/1641] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:00.251354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3fba-b874-4a55-b511-a7a67c6d1502 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:00.251653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3fba-b874-4a55-b511-a7a67c6d1502 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:00.251962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3fba-b874-4a55-b511-a7a67c6d1502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:00.281312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bb1c3fba-b874-4a55-b511-a7a67c6d1502 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:00.284687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bb1c3fba-b874-4a55-b511-a7a67c6d1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:00.323393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 829/1642] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:00.327700 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0123-c627-4ee8-85f5-0e8031a167ae None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:00.343964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0123-c627-4ee8-85f5-0e8031a167ae None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:00.357695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e113ac-2bf2-4892-838c-01418cdaa823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:00.359012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e113ac-2bf2-4892-838c-01418cdaa823 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:00.359445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e113ac-2bf2-4892-838c-01418cdaa823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:00.360051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e113ac-2bf2-4892-838c-01418cdaa823 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:00.362112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e113ac-2bf2-4892-838c-01418cdaa823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:00.364047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e113ac-2bf2-4892-838c-01418cdaa823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:00.369133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e113ac-2bf2-4892-838c-01418cdaa823 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:00.400855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 814/1643] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:00.405650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c3fba-b874-4a55-b511-a7a67c6d1502 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:00.422144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c3fba-b874-4a55-b511-a7a67c6d1502 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:00.435014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f7414-a739-4d38-a25f-03c208553007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:00.436072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f7414-a739-4d38-a25f-03c208553007 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:00.444448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f7414-a739-4d38-a25f-03c208553007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:00.445878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f7414-a739-4d38-a25f-03c208553007 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:00.447135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f7414-a739-4d38-a25f-03c208553007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:00.453462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f7414-a739-4d38-a25f-03c208553007 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:00.519862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 830/1644] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:00 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:00.524758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e113ac-2bf2-4892-838c-01418cdaa823 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:00.541323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e113ac-2bf2-4892-838c-01418cdaa823 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:00.693903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb6460-41ba-4b14-9cec-199c3814455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:00.704489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb6460-41ba-4b14-9cec-199c3814455a admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:00.707319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb6460-41ba-4b14-9cec-199c3814455a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:00.709759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb6460-41ba-4b14-9cec-199c3814455a admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:00.712556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb6460-41ba-4b14-9cec-199c3814455a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:00.718458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb6460-41ba-4b14-9cec-199c3814455a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:00.775029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 815/1645] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:00 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:00.778693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f7414-a739-4d38-a25f-03c208553007 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:00.797284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f7414-a739-4d38-a25f-03c208553007 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:00.812255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb93fd-7086-48d5-aefc-7763e1739558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:00.813682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb93fd-7086-48d5-aefc-7763e1739558 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:00.814108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb93fd-7086-48d5-aefc-7763e1739558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:00.814572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb93fd-7086-48d5-aefc-7763e1739558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:00.816326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb93fd-7086-48d5-aefc-7763e1739558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:00.819082 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb93fd-7086-48d5-aefc-7763e1739558 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:00.842467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 831/1646] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:00.846285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb6460-41ba-4b14-9cec-199c3814455a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:00.875927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb6460-41ba-4b14-9cec-199c3814455a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:00.893795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4b3e4-641a-4104-b4bb-7a5e504a3e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:00.894552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b3e4-641a-4104-b4bb-7a5e504a3e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:00.894897 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b3e4-641a-4104-b4bb-7a5e504a3e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:00.896952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b3e4-641a-4104-b4bb-7a5e504a3e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:00.897824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4b3e4-641a-4104-b4bb-7a5e504a3e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:00.904313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4b3e4-641a-4104-b4bb-7a5e504a3e07 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:00.923426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 816/1647] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:00.926746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb93fd-7086-48d5-aefc-7763e1739558 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:00.947180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb93fd-7086-48d5-aefc-7763e1739558 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:00.958233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6108c6-b030-4685-bb4b-d7797b58c061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:00.967250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6108c6-b030-4685-bb4b-d7797b58c061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:00.967635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6108c6-b030-4685-bb4b-d7797b58c061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:00.968160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6108c6-b030-4685-bb4b-d7797b58c061 admin admin] PATH_INFO: `/v3/projects/7c9a59d381f149f491a7d4405bd6bdd8/users/4a776b57188941afb75a2ecbf07ebac4/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:00.989893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6108c6-b030-4685-bb4b-d7797b58c061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9a59d381f149f491a7d4405bd6bdd8, user_id=4a776b57188941afb75a2ecbf07ebac4, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:00.995996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6108c6-b030-4685-bb4b-d7797b58c061 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:01.035660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 832/1648] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:00 2022] PUT /identity/v3/projects/7c9a59d381f149f491a7d4405bd6bdd8/users/4a776b57188941afb75a2ecbf07ebac4/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:01.037621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb0f65-1c32-4c30-a67c-e6bccc50cb1f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:01.037924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb0f65-1c32-4c30-a67c-e6bccc50cb1f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:01.038214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb0f65-1c32-4c30-a67c-e6bccc50cb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:01.112287 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-19eb0f65-1c32-4c30-a67c-e6bccc50cb1f None None] MFA Rules not processed for user `4a776b57188941afb75a2ecbf07ebac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:01.121075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-19eb0f65-1c32-4c30-a67c-e6bccc50cb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:01.322358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 817/1649] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:01.322504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6108c6-b030-4685-bb4b-d7797b58c061 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:01.504390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6108c6-b030-4685-bb4b-d7797b58c061 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:01.515645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1117c-e96e-4c63-b140-426ae485068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:01.516416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1117c-e96e-4c63-b140-426ae485068f admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:01.516728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1117c-e96e-4c63-b140-426ae485068f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:01.517033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1117c-e96e-4c63-b140-426ae485068f admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:01.517783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1117c-e96e-4c63-b140-426ae485068f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:01.521001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1117c-e96e-4c63-b140-426ae485068f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:01.585950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 833/1650] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:01 2022] POST /identity/v3/projects => generated 403 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:12:01.587519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb0f65-1c32-4c30-a67c-e6bccc50cb1f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:01.607029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb0f65-1c32-4c30-a67c-e6bccc50cb1f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:01.721733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1117c-e96e-4c63-b140-426ae485068f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:01.723590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4ed1117c-e96e-4c63-b140-426ae485068f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:01.738965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:01.793515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134db896-64db-47f4-a0a9-8430eea5c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:01.794315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134db896-64db-47f4-a0a9-8430eea5c591 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:01.794698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134db896-64db-47f4-a0a9-8430eea5c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:01.795077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134db896-64db-47f4-a0a9-8430eea5c591 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:01.796070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134db896-64db-47f4-a0a9-8430eea5c591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:01.798268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134db896-64db-47f4-a0a9-8430eea5c591 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:01.849008 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 818/1651] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:01 2022] POST /identity/v3/users => generated 308 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:01.850240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134db896-64db-47f4-a0a9-8430eea5c591 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:01.872128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134db896-64db-47f4-a0a9-8430eea5c591 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:01.887970 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147811ae-5214-4c67-b981-7bfa1f950bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:01.890226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147811ae-5214-4c67-b981-7bfa1f950bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:01.890579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147811ae-5214-4c67-b981-7bfa1f950bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:01.891288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147811ae-5214-4c67-b981-7bfa1f950bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:01.893098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147811ae-5214-4c67-b981-7bfa1f950bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:01.907510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147811ae-5214-4c67-b981-7bfa1f950bc9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:01.937989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:01.962042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 819/1652] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:01.978609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147811ae-5214-4c67-b981-7bfa1f950bc9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:01.980939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1117c-e96e-4c63-b140-426ae485068f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:01.996565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:01.997493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:01.997783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:01.998064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] PATH_INFO: `/v3/users/5ab554c1324a4524925126cf017de666` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:02.005248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab554c1324a4524925126cf017de666)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:02.010282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147811ae-5214-4c67-b981-7bfa1f950bc9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:02.010590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: WARNING py.warnings [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:12:02.010590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: warnings.warn(msg) Jul 13 22:12:02.010590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: Jul 13 22:12:02.011949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:02.031476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594685fa-2fd6-4c1b-a45b-964b0725476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:02.032448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594685fa-2fd6-4c1b-a45b-964b0725476d admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:02.032723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594685fa-2fd6-4c1b-a45b-964b0725476d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:02.033001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594685fa-2fd6-4c1b-a45b-964b0725476d admin admin] PATH_INFO: `/v3/projects/f8e2bab4146543cc8fd6e3e3e4685390/users/c5c4d5e5c26845a5b1ccd1bc66f92d89/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:02.068521 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594685fa-2fd6-4c1b-a45b-964b0725476d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e2bab4146543cc8fd6e3e3e4685390, user_id=c5c4d5e5c26845a5b1ccd1bc66f92d89, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:02.078917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594685fa-2fd6-4c1b-a45b-964b0725476d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:02.112618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 820/1653] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:01 2022] PUT /identity/v3/projects/f8e2bab4146543cc8fd6e3e3e4685390/users/c5c4d5e5c26845a5b1ccd1bc66f92d89/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:02.115805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594685fa-2fd6-4c1b-a45b-964b0725476d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:02.245792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab554c1324a4524925126cf017de666'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:02.272489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab554c1324a4524925126cf017de666'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:02.331070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab554c1324a4524925126cf017de666'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:02.333951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab554c1324a4524925126cf017de666'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:02.336752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-5da6339d-873d-4002-b231-3c88043d3aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab554c1324a4524925126cf017de666'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:02.357642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594685fa-2fd6-4c1b-a45b-964b0725476d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:02.381142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a2e8-ba17-43c5-92ad-1cccb16f4c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:02.385845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a2e8-ba17-43c5-92ad-1cccb16f4c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:02.386398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a2e8-ba17-43c5-92ad-1cccb16f4c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:02.388034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a2e8-ba17-43c5-92ad-1cccb16f4c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:02.393992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a2e8-ba17-43c5-92ad-1cccb16f4c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:02.397447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 834/1654] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:01 2022] DELETE /identity/v3/users/5ab554c1324a4524925126cf017de666 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:02.399375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a2e8-ba17-43c5-92ad-1cccb16f4c59 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:02.399841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6616e-be3b-42e7-aa2a-1266b770ec8d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:02.400177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6616e-be3b-42e7-aa2a-1266b770ec8d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:02.400460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6616e-be3b-42e7-aa2a-1266b770ec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:02.439911 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 821/1655] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:12:02.447177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-63f6616e-be3b-42e7-aa2a-1266b770ec8d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:02.450120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a2e8-ba17-43c5-92ad-1cccb16f4c59 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:02.455730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-63f6616e-be3b-42e7-aa2a-1266b770ec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:02.456843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6808a2e8-ba17-43c5-92ad-1cccb16f4c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:02.506708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a2e8-ba17-43c5-92ad-1cccb16f4c59 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:02.624724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 835/1656] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:02.730418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a555c91-be79-446b-98e8-d34836668f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:02.732502 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a555c91-be79-446b-98e8-d34836668f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:02.733695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a555c91-be79-446b-98e8-d34836668f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:02.734544 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a555c91-be79-446b-98e8-d34836668f14 admin admin] PATH_INFO: `/v3/projects/f8e2bab4146543cc8fd6e3e3e4685390/users/c5c4d5e5c26845a5b1ccd1bc66f92d89/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:02.739739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a555c91-be79-446b-98e8-d34836668f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e2bab4146543cc8fd6e3e3e4685390, user_id=c5c4d5e5c26845a5b1ccd1bc66f92d89, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:02.747570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a555c91-be79-446b-98e8-d34836668f14 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:02.763214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6616e-be3b-42e7-aa2a-1266b770ec8d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:02.765351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-63f6616e-be3b-42e7-aa2a-1266b770ec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:02.789798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 822/1657] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:02 2022] PUT /identity/v3/projects/f8e2bab4146543cc8fd6e3e3e4685390/users/c5c4d5e5c26845a5b1ccd1bc66f92d89/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:02.792644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02452c-04f6-4ade-83ca-46d207cdd771 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:02.793196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02452c-04f6-4ade-83ca-46d207cdd771 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:02.793812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02452c-04f6-4ade-83ca-46d207cdd771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:02.870058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-af02452c-04f6-4ade-83ca-46d207cdd771 None None] MFA Rules not processed for user `c5c4d5e5c26845a5b1ccd1bc66f92d89`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:02.871969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-af02452c-04f6-4ade-83ca-46d207cdd771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:02.894357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:02.980576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6616e-be3b-42e7-aa2a-1266b770ec8d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:03.037441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:03.064291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 823/1658] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:03.079886 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83633005-c73a-4002-ac06-9fa6ef94c680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:03.080265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02452c-04f6-4ade-83ca-46d207cdd771 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:03.080595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83633005-c73a-4002-ac06-9fa6ef94c680 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:03.080937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83633005-c73a-4002-ac06-9fa6ef94c680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:03.081283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83633005-c73a-4002-ac06-9fa6ef94c680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:03.082553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-af02452c-04f6-4ade-83ca-46d207cdd771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:03.184554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83633005-c73a-4002-ac06-9fa6ef94c680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:03.186251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83633005-c73a-4002-ac06-9fa6ef94c680 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:03.205650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 836/1659] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:03.254033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02452c-04f6-4ade-83ca-46d207cdd771 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:03.264511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be147b-b9a5-4b10-a16c-e4b5ab3be4c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:03.265218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be147b-b9a5-4b10-a16c-e4b5ab3be4c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:03.265580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be147b-b9a5-4b10-a16c-e4b5ab3be4c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:03.265780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be147b-b9a5-4b10-a16c-e4b5ab3be4c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:03.289376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be147b-b9a5-4b10-a16c-e4b5ab3be4c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:03.294852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be147b-b9a5-4b10-a16c-e4b5ab3be4c2 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:03.321219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 824/1660] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:03.773998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83633005-c73a-4002-ac06-9fa6ef94c680 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:03.776339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-83633005-c73a-4002-ac06-9fa6ef94c680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:03.802784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83633005-c73a-4002-ac06-9fa6ef94c680 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:03.818488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:03.819395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:03.823385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:03.823762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] PATH_INFO: `/v3/users/94f0e18923564b29a3f88ce167af788a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:03.826140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f0e18923564b29a3f88ce167af788a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:03.831072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:03.923404 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be147b-b9a5-4b10-a16c-e4b5ab3be4c2 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:03.944321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be147b-b9a5-4b10-a16c-e4b5ab3be4c2 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:03.959397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:03.960334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:03.960694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:03.961173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] PATH_INFO: `/v3/users/4a776b57188941afb75a2ecbf07ebac4` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:03.968701 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a776b57188941afb75a2ecbf07ebac4)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:03.970705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:03.975049 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f0e18923564b29a3f88ce167af788a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.009238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f0e18923564b29a3f88ce167af788a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.037422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f0e18923564b29a3f88ce167af788a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.040533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f0e18923564b29a3f88ce167af788a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.042261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b943ef45-295b-4b6f-add9-9709896a7242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f0e18923564b29a3f88ce167af788a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.111349 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 837/1661] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:03 2022] DELETE /identity/v3/users/94f0e18923564b29a3f88ce167af788a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:04.123472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007368da-7b7b-4092-b7a9-224ac4da1f0d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:04.123767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007368da-7b7b-4092-b7a9-224ac4da1f0d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:04.124123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007368da-7b7b-4092-b7a9-224ac4da1f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:04.149686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a776b57188941afb75a2ecbf07ebac4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.163098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a776b57188941afb75a2ecbf07ebac4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.165000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a776b57188941afb75a2ecbf07ebac4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.187750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a776b57188941afb75a2ecbf07ebac4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.189554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ea96c059-acde-4d77-916a-1052ec07b802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a776b57188941afb75a2ecbf07ebac4'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:04.200800 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-007368da-7b7b-4092-b7a9-224ac4da1f0d None None] MFA Rules not processed for user `35e1226e11a7464a84676eba1b63c8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:04.202647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-007368da-7b7b-4092-b7a9-224ac4da1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:04.220779 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 825/1662] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:03 2022] DELETE /identity/v3/users/4a776b57188941afb75a2ecbf07ebac4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:04.225896 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf270be-2c9b-4a1d-ac89-c925a673ac58 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:04.226956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf270be-2c9b-4a1d-ac89-c925a673ac58 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:04.228529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf270be-2c9b-4a1d-ac89-c925a673ac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:04.257684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ecf270be-2c9b-4a1d-ac89-c925a673ac58 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:04.261628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ecf270be-2c9b-4a1d-ac89-c925a673ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:04.284255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:04.286809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:04.339884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 838/1663] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:04.341692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa818fe0-2c1a-4c34-9af8-69472e873f81 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:04.342254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa818fe0-2c1a-4c34-9af8-69472e873f81 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:04.342744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa818fe0-2c1a-4c34-9af8-69472e873f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:04.373486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 826/1664] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:04.379233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fa818fe0-2c1a-4c34-9af8-69472e873f81 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:04.383177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fa818fe0-2c1a-4c34-9af8-69472e873f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:04.405186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 839/1665] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:04.442492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf270be-2c9b-4a1d-ac89-c925a673ac58 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:04.453613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ecf270be-2c9b-4a1d-ac89-c925a673ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:04.460358 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa818fe0-2c1a-4c34-9af8-69472e873f81 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:04.462425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fa818fe0-2c1a-4c34-9af8-69472e873f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:04.577652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa818fe0-2c1a-4c34-9af8-69472e873f81 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:04.590713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4c051-8114-40b4-a3ac-c2323366ab6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:04.591391 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4c051-8114-40b4-a3ac-c2323366ab6c service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:04.591680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4c051-8114-40b4-a3ac-c2323366ab6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:04.591986 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4c051-8114-40b4-a3ac-c2323366ab6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:04.610453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4c051-8114-40b4-a3ac-c2323366ab6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:04.611968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4c051-8114-40b4-a3ac-c2323366ab6c service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:04.638253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 840/1666] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:04.639171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf270be-2c9b-4a1d-ac89-c925a673ac58 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:04.649907 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf2e0a-f2ed-4672-a605-da04722746f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:04.652054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf2e0a-f2ed-4672-a605-da04722746f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:04.652351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf2e0a-f2ed-4672-a605-da04722746f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:04.653430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf2e0a-f2ed-4672-a605-da04722746f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:04.687221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf2e0a-f2ed-4672-a605-da04722746f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:04.688716 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf2e0a-f2ed-4672-a605-da04722746f7 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:04.703490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 827/1667] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:05.881264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4c051-8114-40b4-a3ac-c2323366ab6c service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:05.884456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-79e4c051-8114-40b4-a3ac-c2323366ab6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:05.912067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4c051-8114-40b4-a3ac-c2323366ab6c service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:05.923163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:05.924573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:05.925073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:05.925556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] PATH_INFO: `/v3/projects/efca2bda9b0943ceb7a0ac02ba93de4a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:05.934306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efca2bda9b0943ceb7a0ac02ba93de4a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:05.936676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:06.102881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efca2bda9b0943ceb7a0ac02ba93de4a', 'request_id': 'req-abde94af-3f5e-4c4f-8320-0f382c1a9869'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.115152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf2e0a-f2ed-4672-a605-da04722746f7 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:06.117215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efca2bda9b0943ceb7a0ac02ba93de4a', 'request_id': 'req-abde94af-3f5e-4c4f-8320-0f382c1a9869'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.118726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-60bf2e0a-f2ed-4672-a605-da04722746f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:06.137461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efca2bda9b0943ceb7a0ac02ba93de4a', 'request_id': 'req-abde94af-3f5e-4c4f-8320-0f382c1a9869'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.153463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] The token cache is being invalidate because project efca2bda9b0943ceb7a0ac02ba93de4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:06.153861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.158856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf2e0a-f2ed-4672-a605-da04722746f7 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:06.159176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-abde94af-3f5e-4c4f-8320-0f382c1a9869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.161158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 841/1668] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:05 2022] DELETE /identity/v3/projects/efca2bda9b0943ceb7a0ac02ba93de4a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:06.167094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4271-6499-4146-a373-71902ae7f3a2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.167094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4271-6499-4146-a373-71902ae7f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.167486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4271-6499-4146-a373-71902ae7f3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.204593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fc5b4271-6499-4146-a373-71902ae7f3a2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:06.206562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fc5b4271-6499-4146-a373-71902ae7f3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:06.311501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:06.342969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:06.343604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.343909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.344195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] PATH_INFO: `/v3/projects/9ca6bef8c7e8436aa243006148db1a2c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.347404 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca6bef8c7e8436aa243006148db1a2c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:06.348471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: WARNING py.warnings [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 22:12:06.348471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: warnings.warn(msg) Jul 13 22:12:06.348471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: Jul 13 22:12:06.349669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:06.354954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 842/1669] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:06.363192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cca161-3a69-4a39-95d0-c58cb1457764 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.363359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cca161-3a69-4a39-95d0-c58cb1457764 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.363669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cca161-3a69-4a39-95d0-c58cb1457764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.400923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-02cca161-3a69-4a39-95d0-c58cb1457764 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:06.408548 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-02cca161-3a69-4a39-95d0-c58cb1457764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:06.424988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 843/1670] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:06.428958 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cca161-3a69-4a39-95d0-c58cb1457764 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:06.450191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cca161-3a69-4a39-95d0-c58cb1457764 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:06.459518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8c293-2546-41e7-8a7f-b27798b7973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:06.462104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8c293-2546-41e7-8a7f-b27798b7973e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.463829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8c293-2546-41e7-8a7f-b27798b7973e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.464716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8c293-2546-41e7-8a7f-b27798b7973e admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.467050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8c293-2546-41e7-8a7f-b27798b7973e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:06.469012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8c293-2546-41e7-8a7f-b27798b7973e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:06.471453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8c293-2546-41e7-8a7f-b27798b7973e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:06.499503 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 844/1671] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:12:06.503976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8c293-2546-41e7-8a7f-b27798b7973e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:06.516304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca6bef8c7e8436aa243006148db1a2c', 'request_id': 'req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.529167 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8c293-2546-41e7-8a7f-b27798b7973e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:06.547441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca6bef8c7e8436aa243006148db1a2c', 'request_id': 'req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.559170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca6bef8c7e8436aa243006148db1a2c', 'request_id': 'req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.562211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:06.589243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] The token cache is being invalidate because project 9ca6bef8c7e8436aa243006148db1a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:06.589605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.590730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5a1b900d-fbc9-45ad-ba86-1d9d7b3d1138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:06.599186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 828/1672] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:06 2022] DELETE /identity/v3/projects/9ca6bef8c7e8436aa243006148db1a2c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:06.618796 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881061e0-656f-45eb-96e2-912c890d4614 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.619185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881061e0-656f-45eb-96e2-912c890d4614 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.619484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881061e0-656f-45eb-96e2-912c890d4614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.674614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-881061e0-656f-45eb-96e2-912c890d4614 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:06.675921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-881061e0-656f-45eb-96e2-912c890d4614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:06.688467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dffb1-1608-4c70-b0de-5f5cb1597d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:06.689501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dffb1-1608-4c70-b0de-5f5cb1597d09 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.691072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dffb1-1608-4c70-b0de-5f5cb1597d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.691678 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dffb1-1608-4c70-b0de-5f5cb1597d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.693454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dffb1-1608-4c70-b0de-5f5cb1597d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:06.700000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 829/1673] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:06.700163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dffb1-1608-4c70-b0de-5f5cb1597d09 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:06.701678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2f1c-f58c-4c51-898f-2b89141da3ee None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.701959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2f1c-f58c-4c51-898f-2b89141da3ee None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.702248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2f1c-f58c-4c51-898f-2b89141da3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.726466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9f9e2f1c-f58c-4c51-898f-2b89141da3ee None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:06.728049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9f9e2f1c-f58c-4c51-898f-2b89141da3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:06.740276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 830/1674] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:06.743353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2f1c-f58c-4c51-898f-2b89141da3ee None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:06.764052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 845/1675] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:06 2022] POST /identity/v3/projects => generated 365 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:06.765040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2f1c-f58c-4c51-898f-2b89141da3ee None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:06.765499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dffb1-1608-4c70-b0de-5f5cb1597d09 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:06.768673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bb5dffb1-1608-4c70-b0de-5f5cb1597d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:06.880784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0fab-d9f8-4751-b370-267a6ef41404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:06.881512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0fab-d9f8-4751-b370-267a6ef41404 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.881805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0fab-d9f8-4751-b370-267a6ef41404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.882091 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0fab-d9f8-4751-b370-267a6ef41404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.882957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dffb1-1608-4c70-b0de-5f5cb1597d09 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:06.883663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d0fab-d9f8-4751-b370-267a6ef41404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:06.883744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d0fab-d9f8-4751-b370-267a6ef41404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:06.885406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d0fab-d9f8-4751-b370-267a6ef41404 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:06.891351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd861f-8bb0-43c1-b00c-fd46fc625c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:06.892745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd861f-8bb0-43c1-b00c-fd46fc625c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.893299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd861f-8bb0-43c1-b00c-fd46fc625c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.893775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd861f-8bb0-43c1-b00c-fd46fc625c4f admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.894711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd861f-8bb0-43c1-b00c-fd46fc625c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:06.897047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd861f-8bb0-43c1-b00c-fd46fc625c4f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:06.920951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 831/1676] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:06.922504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0fab-d9f8-4751-b370-267a6ef41404 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:06.939468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0fab-d9f8-4751-b370-267a6ef41404 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:06.948088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 846/1677] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:06 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:06.949739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd861f-8bb0-43c1-b00c-fd46fc625c4f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:06.956311 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982eed77-f38d-4139-af26-12ea61807c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:06.957034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eed77-f38d-4139-af26-12ea61807c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.957325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eed77-f38d-4139-af26-12ea61807c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.957610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eed77-f38d-4139-af26-12ea61807c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.958323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982eed77-f38d-4139-af26-12ea61807c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:06.960731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982eed77-f38d-4139-af26-12ea61807c6c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:06.965490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd861f-8bb0-43c1-b00c-fd46fc625c4f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:06.979372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f87aa4-7ef6-49a7-9982-51705ebe5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:06.981989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87aa4-7ef6-49a7-9982-51705ebe5543 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:06.984699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87aa4-7ef6-49a7-9982-51705ebe5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:06.985243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87aa4-7ef6-49a7-9982-51705ebe5543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:06.986223 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f87aa4-7ef6-49a7-9982-51705ebe5543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:06.993545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f87aa4-7ef6-49a7-9982-51705ebe5543 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:07.022283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 832/1678] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:06 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:12:07.025686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982eed77-f38d-4139-af26-12ea61807c6c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:07.050354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 847/1679] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:07.051844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f87aa4-7ef6-49a7-9982-51705ebe5543 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:07.066331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f87aa4-7ef6-49a7-9982-51705ebe5543 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:07.140848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982eed77-f38d-4139-af26-12ea61807c6c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:07.146003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b3b67-a191-4d8c-89c2-13e30de5178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:07.146696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b3b67-a191-4d8c-89c2-13e30de5178d admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.146984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b3b67-a191-4d8c-89c2-13e30de5178d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.147580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b3b67-a191-4d8c-89c2-13e30de5178d admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.148505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b3b67-a191-4d8c-89c2-13e30de5178d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:07.150461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b3b67-a191-4d8c-89c2-13e30de5178d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:07.161025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:07.178345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 833/1680] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:07 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:07.186969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b3b67-a191-4d8c-89c2-13e30de5178d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:07.219948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b3b67-a191-4d8c-89c2-13e30de5178d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:07.243395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849e0c8-a435-4e85-8788-c1c2bd1810a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:07.245258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849e0c8-a435-4e85-8788-c1c2bd1810a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.245549 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849e0c8-a435-4e85-8788-c1c2bd1810a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.245838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849e0c8-a435-4e85-8788-c1c2bd1810a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.246582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849e0c8-a435-4e85-8788-c1c2bd1810a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:07.248324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b86a0-14f0-4f93-b7e4-14015c65f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:07.249573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b86a0-14f0-4f93-b7e4-14015c65f17f admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.249573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b86a0-14f0-4f93-b7e4-14015c65f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.249573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b86a0-14f0-4f93-b7e4-14015c65f17f admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.250287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b86a0-14f0-4f93-b7e4-14015c65f17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:07.253236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849e0c8-a435-4e85-8788-c1c2bd1810a1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:07.254314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b86a0-14f0-4f93-b7e4-14015c65f17f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:07.282821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 834/1681] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:07.286313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 848/1682] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:07.287393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849e0c8-a435-4e85-8788-c1c2bd1810a1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:07.292357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b86a0-14f0-4f93-b7e4-14015c65f17f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:07.318861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849e0c8-a435-4e85-8788-c1c2bd1810a1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:07.328165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b86a0-14f0-4f93-b7e4-14015c65f17f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:07.338641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48febdbc-2a2d-4028-a0d5-ebb9220acec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:07.339339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48febdbc-2a2d-4028-a0d5-ebb9220acec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.339629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48febdbc-2a2d-4028-a0d5-ebb9220acec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.339923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48febdbc-2a2d-4028-a0d5-ebb9220acec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.340678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48febdbc-2a2d-4028-a0d5-ebb9220acec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:07.342290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48febdbc-2a2d-4028-a0d5-ebb9220acec2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:07.344210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cec2a-2b64-401e-8c3d-f64a9ff327c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:07.345125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cec2a-2b64-401e-8c3d-f64a9ff327c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.345411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cec2a-2b64-401e-8c3d-f64a9ff327c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.345690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cec2a-2b64-401e-8c3d-f64a9ff327c2 admin admin] PATH_INFO: `/v3/projects/4cacd535634e4edca070e4e8894dce21/users/f78da04a11f94b00b0e3a1f07b42fe02/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.373068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 835/1683] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:07.378628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48febdbc-2a2d-4028-a0d5-ebb9220acec2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:07.393869 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cec2a-2b64-401e-8c3d-f64a9ff327c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cacd535634e4edca070e4e8894dce21, user_id=f78da04a11f94b00b0e3a1f07b42fe02, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:07.398422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cec2a-2b64-401e-8c3d-f64a9ff327c2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:07.413020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48febdbc-2a2d-4028-a0d5-ebb9220acec2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:07.432394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c18f2-5fcc-4222-abf6-3e96ded95262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:07.446615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 849/1684] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:07 2022] PUT /identity/v3/projects/4cacd535634e4edca070e4e8894dce21/users/f78da04a11f94b00b0e3a1f07b42fe02/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:07.447571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c18f2-5fcc-4222-abf6-3e96ded95262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.447571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c18f2-5fcc-4222-abf6-3e96ded95262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.447571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c18f2-5fcc-4222-abf6-3e96ded95262 admin admin] PATH_INFO: `/v3/projects/890c779caf114ded87bb205f33bf6f3a/users/5056b4d0aa554ecd89511dd83bf59472/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.451153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ea032-eb5b-4aad-8916-157f43f2a7d0 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.451929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ea032-eb5b-4aad-8916-157f43f2a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.452762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ea032-eb5b-4aad-8916-157f43f2a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.502352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c18f2-5fcc-4222-abf6-3e96ded95262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890c779caf114ded87bb205f33bf6f3a, user_id=5056b4d0aa554ecd89511dd83bf59472, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:07.512022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c18f2-5fcc-4222-abf6-3e96ded95262 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:07.518437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:07.557562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 836/1685] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:07 2022] PUT /identity/v3/projects/890c779caf114ded87bb205f33bf6f3a/users/5056b4d0aa554ecd89511dd83bf59472/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:07.559020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-db6ea032-eb5b-4aad-8916-157f43f2a7d0 None None] MFA Rules not processed for user `f78da04a11f94b00b0e3a1f07b42fe02`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:07.561113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-db6ea032-eb5b-4aad-8916-157f43f2a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:07.561748 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9a9f-4cba-416e-a757-09de48e44603 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.562055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9a9f-4cba-416e-a757-09de48e44603 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.562384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9a9f-4cba-416e-a757-09de48e44603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.638853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c88b9a9f-4cba-416e-a757-09de48e44603 None None] MFA Rules not processed for user `5056b4d0aa554ecd89511dd83bf59472`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:07.642873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c88b9a9f-4cba-416e-a757-09de48e44603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:07.750265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 850/1686] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:07.750265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a0f1-6271-4441-a380-b9c228e863cf None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.750265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a0f1-6271-4441-a380-b9c228e863cf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.750265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a0f1-6271-4441-a380-b9c228e863cf None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.750633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 851/1687] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:12:07.751203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381a0f1-6271-4441-a380-b9c228e863cf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:07.759192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c381a0f1-6271-4441-a380-b9c228e863cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:07.850420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 837/1688] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:07.851550 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9a9f-4cba-416e-a757-09de48e44603 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:07.923615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381a0f1-6271-4441-a380-b9c228e863cf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:07.941981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:07.944690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:07.945213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:07.946009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] PATH_INFO: `/v3/projects/7c9a59d381f149f491a7d4405bd6bdd8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:07.952059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9a59d381f149f491a7d4405bd6bdd8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:07.959881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:08.047452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9a9f-4cba-416e-a757-09de48e44603 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:08.061764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad719ec-cd4a-4cc7-ab04-50f713a53010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:08.062858 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad719ec-cd4a-4cc7-ab04-50f713a53010 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.063317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad719ec-cd4a-4cc7-ab04-50f713a53010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.063984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad719ec-cd4a-4cc7-ab04-50f713a53010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.064985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad719ec-cd4a-4cc7-ab04-50f713a53010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:08.068017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad719ec-cd4a-4cc7-ab04-50f713a53010 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:08.082838 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:08.097765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9a59d381f149f491a7d4405bd6bdd8', 'request_id': 'req-65d103f5-fc9c-4dfb-b976-bae689981fab'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.111754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9a59d381f149f491a7d4405bd6bdd8', 'request_id': 'req-65d103f5-fc9c-4dfb-b976-bae689981fab'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.137691 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9a59d381f149f491a7d4405bd6bdd8', 'request_id': 'req-65d103f5-fc9c-4dfb-b976-bae689981fab'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.150410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 838/1689] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:07 2022] POST /identity/v3/projects => generated 363 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:08.151270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad719ec-cd4a-4cc7-ab04-50f713a53010 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:08.156668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] The token cache is being invalidate because project 7c9a59d381f149f491a7d4405bd6bdd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:08.157070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.159480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-65d103f5-fc9c-4dfb-b976-bae689981fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.161753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 852/1690] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:07 2022] DELETE /identity/v3/projects/7c9a59d381f149f491a7d4405bd6bdd8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:08.163104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bd957-855b-4ffa-833a-d4ba4c771233 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.164510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bd957-855b-4ffa-833a-d4ba4c771233 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.165036 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bd957-855b-4ffa-833a-d4ba4c771233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.219200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6c2bd957-855b-4ffa-833a-d4ba4c771233 None None] MFA Rules not processed for user `1dd6827b3db547b58560a1d4f89e9c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:08.222577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6c2bd957-855b-4ffa-833a-d4ba4c771233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:08.256141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad719ec-cd4a-4cc7-ab04-50f713a53010 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:08.267233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b74f2-32f9-4dbe-bffd-530c93b7d101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:08.267564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b74f2-32f9-4dbe-bffd-530c93b7d101 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.267852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b74f2-32f9-4dbe-bffd-530c93b7d101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.268158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b74f2-32f9-4dbe-bffd-530c93b7d101 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.269189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b74f2-32f9-4dbe-bffd-530c93b7d101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:08.270813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b74f2-32f9-4dbe-bffd-530c93b7d101 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:08.303064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:08.333055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 839/1691] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:08 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:08.338031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b74f2-32f9-4dbe-bffd-530c93b7d101 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:08.343773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a42b74f2-32f9-4dbe-bffd-530c93b7d101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:08.391779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 853/1692] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:12:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:08.397233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bd957-855b-4ffa-833a-d4ba4c771233 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:08.420903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6c2bd957-855b-4ffa-833a-d4ba4c771233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:08.451399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bd957-855b-4ffa-833a-d4ba4c771233 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:08.504785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b74f2-32f9-4dbe-bffd-530c93b7d101 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:08.529021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b76c2-2a5f-4fe1-a70c-802a1a67b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:08.531023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b76c2-2a5f-4fe1-a70c-802a1a67b2af admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.531397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b76c2-2a5f-4fe1-a70c-802a1a67b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.531759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b76c2-2a5f-4fe1-a70c-802a1a67b2af admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.532945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b76c2-2a5f-4fe1-a70c-802a1a67b2af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:08.535009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b76c2-2a5f-4fe1-a70c-802a1a67b2af admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:08.584238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:08.586822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.586822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.587024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] PATH_INFO: `/v3/users/c5c4d5e5c26845a5b1ccd1bc66f92d89` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.588480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c4d5e5c26845a5b1ccd1bc66f92d89)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:08.590444 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:08.605660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 840/1693] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:08 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:08.606802 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b76c2-2a5f-4fe1-a70c-802a1a67b2af admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:08.608785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9d9b76c2-2a5f-4fe1-a70c-802a1a67b2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:08.626895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b76c2-2a5f-4fe1-a70c-802a1a67b2af admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:08.633867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c788f4-0582-4466-8ebf-9719a269e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:08.634955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c788f4-0582-4466-8ebf-9719a269e90c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.635346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c788f4-0582-4466-8ebf-9719a269e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.635745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c788f4-0582-4466-8ebf-9719a269e90c admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.637125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c788f4-0582-4466-8ebf-9719a269e90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:08.642688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c788f4-0582-4466-8ebf-9719a269e90c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:08.670202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 841/1694] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:08 2022] POST /identity/v3/users => generated 293 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:08.672096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dde58-51f4-4817-b9c1-2506025c2605 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.672819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dde58-51f4-4817-b9c1-2506025c2605 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.674382 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dde58-51f4-4817-b9c1-2506025c2605 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.680854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c4d5e5c26845a5b1ccd1bc66f92d89'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.683472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 842/1695] 10.222.0.17 () {54 vars in 960 bytes} [Wed Jul 13 22:12:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:12:08.684982 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dde58-51f4-4817-b9c1-2506025c2605 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:08.692854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c4d5e5c26845a5b1ccd1bc66f92d89'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.701232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dde58-51f4-4817-b9c1-2506025c2605 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:08.709614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a861d30-76e1-4126-a473-275f3bd8a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:08.711188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a861d30-76e1-4126-a473-275f3bd8a847 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.711580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a861d30-76e1-4126-a473-275f3bd8a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.711991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a861d30-76e1-4126-a473-275f3bd8a847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.713048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a861d30-76e1-4126-a473-275f3bd8a847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:08.714606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a861d30-76e1-4126-a473-275f3bd8a847 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:08.727622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 843/1696] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:08.728698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a861d30-76e1-4126-a473-275f3bd8a847 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:08.741085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a861d30-76e1-4126-a473-275f3bd8a847 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:08.751206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4565879-e632-4719-b5ec-b92178a8eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:08.752204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4565879-e632-4719-b5ec-b92178a8eb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.752592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4565879-e632-4719-b5ec-b92178a8eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.753001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4565879-e632-4719-b5ec-b92178a8eb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.753903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4565879-e632-4719-b5ec-b92178a8eb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:08.756104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4565879-e632-4719-b5ec-b92178a8eb2f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:08.774275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 844/1697] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:08.775826 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132cf7a-4e04-4b5b-bdd3-d2c78d833c59 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:08.776721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132cf7a-4e04-4b5b-bdd3-d2c78d833c59 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:08.777321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132cf7a-4e04-4b5b-bdd3-d2c78d833c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:08.782931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:08.785910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c4d5e5c26845a5b1ccd1bc66f92d89'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.786977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c4d5e5c26845a5b1ccd1bc66f92d89'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.788127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c4d5e5c26845a5b1ccd1bc66f92d89'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:08.808846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0132cf7a-4e04-4b5b-bdd3-d2c78d833c59 None None] MFA Rules not processed for user `1dd6827b3db547b58560a1d4f89e9c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:08.810191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0132cf7a-4e04-4b5b-bdd3-d2c78d833c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:08.817844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 854/1698] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:08 2022] DELETE /identity/v3/users/c5c4d5e5c26845a5b1ccd1bc66f92d89 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:08.819545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:08.822925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:08.906640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 845/1699] 10.222.0.17 () {58 vars in 1057 bytes} [Wed Jul 13 22:12:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:08.907968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132cf7a-4e04-4b5b-bdd3-d2c78d833c59 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:08.919683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0132cf7a-4e04-4b5b-bdd3-d2c78d833c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:08.943048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132cf7a-4e04-4b5b-bdd3-d2c78d833c59 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:08.994086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7877d5-1cce-432d-aa78-e4f07c08fa63 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:09.009718 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8522ed9-ddae-4003-8ddc-737ac7c614b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:09.010644 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8522ed9-ddae-4003-8ddc-737ac7c614b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:09.010937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8522ed9-ddae-4003-8ddc-737ac7c614b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:09.011219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8522ed9-ddae-4003-8ddc-737ac7c614b2 admin admin] PATH_INFO: `/v3/projects/ccd1e2595c0045c6a5cbbf7025281339/users/ee34586622b44ccb8983bbb260be8066/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:09.014248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:09.048666 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490232c8-7511-4bf9-a03c-c419aeaf9253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:09.052951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8522ed9-ddae-4003-8ddc-737ac7c614b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd1e2595c0045c6a5cbbf7025281339, user_id=ee34586622b44ccb8983bbb260be8066, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:09.054215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490232c8-7511-4bf9-a03c-c419aeaf9253 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:09.054646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490232c8-7511-4bf9-a03c-c419aeaf9253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:09.057436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8522ed9-ddae-4003-8ddc-737ac7c614b2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:09.058808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490232c8-7511-4bf9-a03c-c419aeaf9253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:09.059951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490232c8-7511-4bf9-a03c-c419aeaf9253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:09.062465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490232c8-7511-4bf9-a03c-c419aeaf9253 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:09.078941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 846/1700] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:09.080071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490232c8-7511-4bf9-a03c-c419aeaf9253 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:09.111199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 855/1701] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:08 2022] PUT /identity/v3/projects/ccd1e2595c0045c6a5cbbf7025281339/users/ee34586622b44ccb8983bbb260be8066/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:09.113646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8522ed9-ddae-4003-8ddc-737ac7c614b2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:09.176870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490232c8-7511-4bf9-a03c-c419aeaf9253 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:09.219271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8522ed9-ddae-4003-8ddc-737ac7c614b2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:09.235058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcba47-1376-47e6-b795-51a83641de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:09.236035 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcba47-1376-47e6-b795-51a83641de65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:09.236272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcba47-1376-47e6-b795-51a83641de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:09.236563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcba47-1376-47e6-b795-51a83641de65 admin admin] PATH_INFO: `/v3/projects/fddb58318c784dea94d8fa7b85edcab4/users/077942b9e78c41d3b2651db93861d658/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:09.270212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcba47-1376-47e6-b795-51a83641de65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fddb58318c784dea94d8fa7b85edcab4, user_id=077942b9e78c41d3b2651db93861d658, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:09.275550 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcba47-1376-47e6-b795-51a83641de65 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:09.280889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9751-93ca-46f1-ae37-1bfa163d2a35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:09.281855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9751-93ca-46f1-ae37-1bfa163d2a35 service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:09.281989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9751-93ca-46f1-ae37-1bfa163d2a35 service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:09.282232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9751-93ca-46f1-ae37-1bfa163d2a35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:09.287600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-57cd9751-93ca-46f1-ae37-1bfa163d2a35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:09.307323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9751-93ca-46f1-ae37-1bfa163d2a35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:09.308959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9751-93ca-46f1-ae37-1bfa163d2a35 service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:09.330067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 847/1702] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:09.330948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9751-93ca-46f1-ae37-1bfa163d2a35 service placement] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:09.344239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 856/1703] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:09 2022] PUT /identity/v3/projects/fddb58318c784dea94d8fa7b85edcab4/users/077942b9e78c41d3b2651db93861d658/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:09.346866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92cd36-eb33-482c-b7da-4800fea3143b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:09.347112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92cd36-eb33-482c-b7da-4800fea3143b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:09.347418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92cd36-eb33-482c-b7da-4800fea3143b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:09.357562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9751-93ca-46f1-ae37-1bfa163d2a35 service placement] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:09.436192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4f92cd36-eb33-482c-b7da-4800fea3143b None None] MFA Rules not processed for user `077942b9e78c41d3b2651db93861d658`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:09.441839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4f92cd36-eb33-482c-b7da-4800fea3143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:09.515865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c53a24-4c9b-432b-92cb-2cb928f09576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:09.516582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c53a24-4c9b-432b-92cb-2cb928f09576 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:09.516874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c53a24-4c9b-432b-92cb-2cb928f09576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:09.517161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c53a24-4c9b-432b-92cb-2cb928f09576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:09.517921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c53a24-4c9b-432b-92cb-2cb928f09576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:09.519520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c53a24-4c9b-432b-92cb-2cb928f09576 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:09.558459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 848/1704] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:09.562829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c53a24-4c9b-432b-92cb-2cb928f09576 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:09.578081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:09.590935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c53a24-4c9b-432b-92cb-2cb928f09576 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:09.599884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f1da9-39b5-4cfa-82ec-574f995218b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:09.600973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f1da9-39b5-4cfa-82ec-574f995218b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:09.601916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f1da9-39b5-4cfa-82ec-574f995218b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:09.602208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f1da9-39b5-4cfa-82ec-574f995218b3 admin admin] PATH_INFO: `/v3/projects/ccd1e2595c0045c6a5cbbf7025281339/users/ee34586622b44ccb8983bbb260be8066/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:09.614626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f1da9-39b5-4cfa-82ec-574f995218b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd1e2595c0045c6a5cbbf7025281339, user_id=ee34586622b44ccb8983bbb260be8066, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:09.625457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f1da9-39b5-4cfa-82ec-574f995218b3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:09.635217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:09.642278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 857/1705] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:09.655233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92cd36-eb33-482c-b7da-4800fea3143b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:09.692059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 849/1706] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:09 2022] PUT /identity/v3/projects/ccd1e2595c0045c6a5cbbf7025281339/users/ee34586622b44ccb8983bbb260be8066/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:09.702160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505d17-2bb9-4bed-b08a-f793ad160597 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:09.702714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505d17-2bb9-4bed-b08a-f793ad160597 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:09.703146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505d17-2bb9-4bed-b08a-f793ad160597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:09.718278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92cd36-eb33-482c-b7da-4800fea3143b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:09.834159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-69505d17-2bb9-4bed-b08a-f793ad160597 None None] MFA Rules not processed for user `ee34586622b44ccb8983bbb260be8066`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:09.836653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-69505d17-2bb9-4bed-b08a-f793ad160597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:09.965771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5844dcb-d3da-444c-a09c-7d05ee9f9e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:09.977102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5844dcb-d3da-444c-a09c-7d05ee9f9e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:09.978968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5844dcb-d3da-444c-a09c-7d05ee9f9e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:09.979469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5844dcb-d3da-444c-a09c-7d05ee9f9e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:09.982690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5844dcb-d3da-444c-a09c-7d05ee9f9e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:09.987809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5844dcb-d3da-444c-a09c-7d05ee9f9e69 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:10.095055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 850/1707] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:10.095055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071b994-40bf-46e6-b18b-9140180c60ff None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:10.095055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071b994-40bf-46e6-b18b-9140180c60ff None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:10.095055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071b994-40bf-46e6-b18b-9140180c60ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:10.127847 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 858/1708] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:09 2022] POST /identity/v3/projects => generated 385 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:10.136356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5844dcb-d3da-444c-a09c-7d05ee9f9e69 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:10.144944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d5844dcb-d3da-444c-a09c-7d05ee9f9e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:10.170208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0071b994-40bf-46e6-b18b-9140180c60ff None None] MFA Rules not processed for user `bb4c7ad91bc449f9910d4c4d0327ba71`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:10.171614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0071b994-40bf-46e6-b18b-9140180c60ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:10.279136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 851/1709] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:10.280046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071b994-40bf-46e6-b18b-9140180c60ff None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:10.330653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5844dcb-d3da-444c-a09c-7d05ee9f9e69 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:10.347156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fe73f-3586-4d02-9deb-91b3ca4be446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:10.347824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fe73f-3586-4d02-9deb-91b3ca4be446 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:10.348145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fe73f-3586-4d02-9deb-91b3ca4be446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:10.348428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fe73f-3586-4d02-9deb-91b3ca4be446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:10.403758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071b994-40bf-46e6-b18b-9140180c60ff None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:10.419545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9884-c274-4f08-a0df-243d8a810f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:10.422625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9884-c274-4f08-a0df-243d8a810f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:10.423827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9884-c274-4f08-a0df-243d8a810f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:10.424172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9884-c274-4f08-a0df-243d8a810f5e admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:10.428325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9884-c274-4f08-a0df-243d8a810f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:10.435548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9884-c274-4f08-a0df-243d8a810f5e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:10.470292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:10.484400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 852/1710] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:10 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:10.486754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cdca5-b175-44bc-b685-66f483a429dc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:10.487105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cdca5-b175-44bc-b685-66f483a429dc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:10.487682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cdca5-b175-44bc-b685-66f483a429dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:10.515523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fe73f-3586-4d02-9deb-91b3ca4be446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:10.520740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fe73f-3586-4d02-9deb-91b3ca4be446 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:10.546797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 859/1711] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:10.548370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e07d9-c726-4c7e-baa1-cebdc6d27d1d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:10.548670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e07d9-c726-4c7e-baa1-cebdc6d27d1d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:10.548953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e07d9-c726-4c7e-baa1-cebdc6d27d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:10.590630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-292cdca5-b175-44bc-b685-66f483a429dc None None] MFA Rules not processed for user `966f641526b64cf3aec1744a141a2f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:10.592019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-292cdca5-b175-44bc-b685-66f483a429dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:10.592139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-269e07d9-c726-4c7e-baa1-cebdc6d27d1d None None] MFA Rules not processed for user `bb4c7ad91bc449f9910d4c4d0327ba71`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:10.594524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-269e07d9-c726-4c7e-baa1-cebdc6d27d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:10.620700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 860/1712] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:10.621707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e07d9-c726-4c7e-baa1-cebdc6d27d1d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:10.672271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e07d9-c726-4c7e-baa1-cebdc6d27d1d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:10.695572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d488a98-1f12-4a17-8273-f86b2eaf3ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:10.696454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d488a98-1f12-4a17-8273-f86b2eaf3ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:10.698146 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d488a98-1f12-4a17-8273-f86b2eaf3ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:10.698482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d488a98-1f12-4a17-8273-f86b2eaf3ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:10.701372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d488a98-1f12-4a17-8273-f86b2eaf3ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:10.706548 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d488a98-1f12-4a17-8273-f86b2eaf3ebb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:10.716908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:10.752893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 861/1713] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:10.753961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d488a98-1f12-4a17-8273-f86b2eaf3ebb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:10.758020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3d488a98-1f12-4a17-8273-f86b2eaf3ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:10.845012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 853/1714] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:10.855953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cdca5-b175-44bc-b685-66f483a429dc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:10.890307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cdca5-b175-44bc-b685-66f483a429dc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:10.901415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8763ae-7bd5-4fea-918f-64d99cea9b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:10.902500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8763ae-7bd5-4fea-918f-64d99cea9b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:10.902793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8763ae-7bd5-4fea-918f-64d99cea9b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:10.903075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8763ae-7bd5-4fea-918f-64d99cea9b6d admin admin] PATH_INFO: `/v3/projects/c864a75eecdd4d4c8730155b5c3a36f5/users/1be272bba97641dd89ac31546fb0fdac/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:10.943654 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8763ae-7bd5-4fea-918f-64d99cea9b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c864a75eecdd4d4c8730155b5c3a36f5, user_id=1be272bba97641dd89ac31546fb0fdac, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:10.950060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8763ae-7bd5-4fea-918f-64d99cea9b6d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:10.976369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 854/1715] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:10 2022] PUT /identity/v3/projects/c864a75eecdd4d4c8730155b5c3a36f5/users/1be272bba97641dd89ac31546fb0fdac/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:10.977243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8763ae-7bd5-4fea-918f-64d99cea9b6d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:10.995070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d488a98-1f12-4a17-8273-f86b2eaf3ebb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:11.107269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8763ae-7bd5-4fea-918f-64d99cea9b6d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:11.121792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef41a-7386-478d-8de5-a02abc1c18a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:11.122906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef41a-7386-478d-8de5-a02abc1c18a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:11.123405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef41a-7386-478d-8de5-a02abc1c18a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:11.124071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef41a-7386-478d-8de5-a02abc1c18a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:11.126936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bf4ef41a-7386-478d-8de5-a02abc1c18a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:11.176820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74584862-160b-43e1-a754-609bb2d772d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:11.177456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74584862-160b-43e1-a754-609bb2d772d8 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:11.177661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74584862-160b-43e1-a754-609bb2d772d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:11.180207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74584862-160b-43e1-a754-609bb2d772d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:11.234885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef41a-7386-478d-8de5-a02abc1c18a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:11.236984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef41a-7386-478d-8de5-a02abc1c18a8 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:11.254209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 855/1716] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:11.256712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773d94a-7f3b-48bc-a2d3-45fcc589a70f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:11.257092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773d94a-7f3b-48bc-a2d3-45fcc589a70f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:11.258074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773d94a-7f3b-48bc-a2d3-45fcc589a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:11.306119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f773d94a-7f3b-48bc-a2d3-45fcc589a70f None None] MFA Rules not processed for user `966f641526b64cf3aec1744a141a2f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:11.307395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f773d94a-7f3b-48bc-a2d3-45fcc589a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:11.339074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:11.354272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74584862-160b-43e1-a754-609bb2d772d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:11.356514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74584862-160b-43e1-a754-609bb2d772d8 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:11.380881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 862/1717] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:11.383837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74584862-160b-43e1-a754-609bb2d772d8 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:11.387639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-74584862-160b-43e1-a754-609bb2d772d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:11.485857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:11.504056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 856/1718] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:11.504056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773d94a-7f3b-48bc-a2d3-45fcc589a70f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:11.564645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74584862-160b-43e1-a754-609bb2d772d8 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:11.580947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:11.581860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:11.582146 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:11.582429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] PATH_INFO: `/v3/projects/f8e2bab4146543cc8fd6e3e3e4685390` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:11.584181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e2bab4146543cc8fd6e3e3e4685390)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:11.586617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:11.707728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773d94a-7f3b-48bc-a2d3-45fcc589a70f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:11.742351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e2bab4146543cc8fd6e3e3e4685390', 'request_id': 'req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:11.765190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e2bab4146543cc8fd6e3e3e4685390', 'request_id': 'req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:11.793916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e2bab4146543cc8fd6e3e3e4685390', 'request_id': 'req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:11.815325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] The token cache is being invalidate because project f8e2bab4146543cc8fd6e3e3e4685390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:11.815664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:11.818230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:11.823580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 863/1719] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:11 2022] DELETE /identity/v3/projects/f8e2bab4146543cc8fd6e3e3e4685390 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:11.834809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:11.841209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:11.942160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5452c-0b8b-4ff4-b946-370be4c7c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:11.943086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5452c-0b8b-4ff4-b946-370be4c7c624 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:11.943593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5452c-0b8b-4ff4-b946-370be4c7c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:11.944046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5452c-0b8b-4ff4-b946-370be4c7c624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:11.945568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5452c-0b8b-4ff4-b946-370be4c7c624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:11.947319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5452c-0b8b-4ff4-b946-370be4c7c624 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:11.981275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 857/1720] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:11.983131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7346d0-02f1-4955-bfa9-85e3d36afe6c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:11.983531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7346d0-02f1-4955-bfa9-85e3d36afe6c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:11.983939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7346d0-02f1-4955-bfa9-85e3d36afe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.023861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7a7346d0-02f1-4955-bfa9-85e3d36afe6c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:12.025812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7a7346d0-02f1-4955-bfa9-85e3d36afe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:12.043732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 858/1721] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:12.044742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7346d0-02f1-4955-bfa9-85e3d36afe6c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:12.046258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7a7346d0-02f1-4955-bfa9-85e3d36afe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:12.060445 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe10079-b25b-4fff-a24c-1eeb2ffc5d65 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:12.077544 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7346d0-02f1-4955-bfa9-85e3d36afe6c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:12.078182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d9a5c-e150-467e-a9e2-9d5bfc3a9be8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:12.078867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d9a5c-e150-467e-a9e2-9d5bfc3a9be8 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.079156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d9a5c-e150-467e-a9e2-9d5bfc3a9be8 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.080543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d9a5c-e150-467e-a9e2-9d5bfc3a9be8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.088553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f74d9a5c-e150-467e-a9e2-9d5bfc3a9be8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:12.090396 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a218e7-5c53-4bd9-b773-02cd79a14703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:12.092149 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a218e7-5c53-4bd9-b773-02cd79a14703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.092149 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a218e7-5c53-4bd9-b773-02cd79a14703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.092458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a218e7-5c53-4bd9-b773-02cd79a14703 admin admin] PATH_INFO: `/v3/projects/c864a75eecdd4d4c8730155b5c3a36f5/users/1be272bba97641dd89ac31546fb0fdac/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.097688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a218e7-5c53-4bd9-b773-02cd79a14703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c864a75eecdd4d4c8730155b5c3a36f5, user_id=1be272bba97641dd89ac31546fb0fdac, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:12.108222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a218e7-5c53-4bd9-b773-02cd79a14703 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:12.143943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 859/1722] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:12 2022] PUT /identity/v3/projects/c864a75eecdd4d4c8730155b5c3a36f5/users/1be272bba97641dd89ac31546fb0fdac/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:12.146570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b739-ec06-4e87-b432-4e2307554006 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.146570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b739-ec06-4e87-b432-4e2307554006 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.146839 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b739-ec06-4e87-b432-4e2307554006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.191108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5c20b739-ec06-4e87-b432-4e2307554006 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:12.194024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5c20b739-ec06-4e87-b432-4e2307554006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:12.222470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d9a5c-e150-467e-a9e2-9d5bfc3a9be8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:12.228619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d9a5c-e150-467e-a9e2-9d5bfc3a9be8 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:12.238260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:12.268104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 864/1723] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:12.273584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcaba2-a593-4722-94a5-1e7618b4346a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.273880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcaba2-a593-4722-94a5-1e7618b4346a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.275928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcaba2-a593-4722-94a5-1e7618b4346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.310351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:12.354480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b9fcaba2-a593-4722-94a5-1e7618b4346a None None] MFA Rules not processed for user `1be272bba97641dd89ac31546fb0fdac`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:12.355765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b9fcaba2-a593-4722-94a5-1e7618b4346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:12.383154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 860/1724] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:12.385619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b739-ec06-4e87-b432-4e2307554006 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:12.415025 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b739-ec06-4e87-b432-4e2307554006 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:12.440721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643d189-b787-4121-b932-3e4e03269774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:12.441340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643d189-b787-4121-b932-3e4e03269774 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.441622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643d189-b787-4121-b932-3e4e03269774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.441898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643d189-b787-4121-b932-3e4e03269774 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.442625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643d189-b787-4121-b932-3e4e03269774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:12.442941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643d189-b787-4121-b932-3e4e03269774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:12.451039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643d189-b787-4121-b932-3e4e03269774 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:12.497267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 861/1725] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:12.500604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643d189-b787-4121-b932-3e4e03269774 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:12.542382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 865/1726] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:12.546412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4cd77-f3e6-4e0a-8056-6f64b84bc9a4 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.547372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4cd77-f3e6-4e0a-8056-6f64b84bc9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.547572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4cd77-f3e6-4e0a-8056-6f64b84bc9a4 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.552286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 866/1727] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:12:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:12:12.553459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349ef50-310d-450e-b63f-e13595dad251 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.553566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643d189-b787-4121-b932-3e4e03269774 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:12.554287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349ef50-310d-450e-b63f-e13595dad251 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.554634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349ef50-310d-450e-b63f-e13595dad251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.569571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa6d67-f785-4ca9-a42a-d42b9db21418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:12.571024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa6d67-f785-4ca9-a42a-d42b9db21418 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.571402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa6d67-f785-4ca9-a42a-d42b9db21418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.571688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa6d67-f785-4ca9-a42a-d42b9db21418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.573005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa6d67-f785-4ca9-a42a-d42b9db21418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:12.577865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa6d67-f785-4ca9-a42a-d42b9db21418 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:12.595095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c349ef50-310d-450e-b63f-e13595dad251 None None] MFA Rules not processed for user `71516217b1714e84bda9e584c97e84b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:12.596953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c349ef50-310d-450e-b63f-e13595dad251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:12.634937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 862/1728] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:12 2022] POST /identity/v3/projects => generated 407 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:12:12.635842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa6d67-f785-4ca9-a42a-d42b9db21418 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:12.639776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-77fa6d67-f785-4ca9-a42a-d42b9db21418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:12.805347 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa6d67-f785-4ca9-a42a-d42b9db21418 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:12.831991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c9c4a-735d-4a86-a832-4cf5c11ff1bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:12.835794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c9c4a-735d-4a86-a832-4cf5c11ff1bd service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.838351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c9c4a-735d-4a86-a832-4cf5c11ff1bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.839210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c9c4a-735d-4a86-a832-4cf5c11ff1bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.878178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 867/1729] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:12.884544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa2837-996d-4784-9c9a-f1a1a1b21010 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:12.886062 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa2837-996d-4784-9c9a-f1a1a1b21010 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:12.886459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa2837-996d-4784-9c9a-f1a1a1b21010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:12.968598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b6aa2837-996d-4784-9c9a-f1a1a1b21010 None None] MFA Rules not processed for user `1dd6827b3db547b58560a1d4f89e9c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:12.972902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b6aa2837-996d-4784-9c9a-f1a1a1b21010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:13.001720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c9c4a-735d-4a86-a832-4cf5c11ff1bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:13.003207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c9c4a-735d-4a86-a832-4cf5c11ff1bd service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:13.029753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 863/1730] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:13.031095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c9c4a-735d-4a86-a832-4cf5c11ff1bd service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:13.189352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 868/1731] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:12:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:13.246743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c9c4a-735d-4a86-a832-4cf5c11ff1bd service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:13.259466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fabc1-3473-40d8-901d-7003b3f05dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:13.261594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fabc1-3473-40d8-901d-7003b3f05dae admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:13.263686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fabc1-3473-40d8-901d-7003b3f05dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:13.264202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fabc1-3473-40d8-901d-7003b3f05dae admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:13.265553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fabc1-3473-40d8-901d-7003b3f05dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:13.270514 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fabc1-3473-40d8-901d-7003b3f05dae admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:13.300740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:13.333540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 864/1732] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:13 2022] POST /identity/v3/users => generated 304 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:13.337317 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa2837-996d-4784-9c9a-f1a1a1b21010 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:13.357917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa2837-996d-4784-9c9a-f1a1a1b21010 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:13.378538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db333a7-b063-4d66-84e6-3e4489ad22df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:13.382670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db333a7-b063-4d66-84e6-3e4489ad22df admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:13.383572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db333a7-b063-4d66-84e6-3e4489ad22df admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:13.383863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db333a7-b063-4d66-84e6-3e4489ad22df admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:13.384658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db333a7-b063-4d66-84e6-3e4489ad22df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:13.395056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db333a7-b063-4d66-84e6-3e4489ad22df admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:13.422071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:13.441429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 869/1733] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:13.444954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fabc1-3473-40d8-901d-7003b3f05dae admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:13.477247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b4289-63ff-499a-a73c-75909a481933 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:13.478816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b4289-63ff-499a-a73c-75909a481933 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:13.479210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b4289-63ff-499a-a73c-75909a481933 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:13.483799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fabc1-3473-40d8-901d-7003b3f05dae admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:13.484988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 870/1734] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 13 22:12:13 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:12:13.487549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b4289-63ff-499a-a73c-75909a481933 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:13.496512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d31b4289-63ff-499a-a73c-75909a481933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:13.506652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700ca11-7ac8-48f1-bed1-592648cd8c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:13.510703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700ca11-7ac8-48f1-bed1-592648cd8c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:13.511117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700ca11-7ac8-48f1-bed1-592648cd8c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:13.512645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700ca11-7ac8-48f1-bed1-592648cd8c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:13.514531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700ca11-7ac8-48f1-bed1-592648cd8c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:13.523751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700ca11-7ac8-48f1-bed1-592648cd8c75 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:13.567037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b4289-63ff-499a-a73c-75909a481933 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:13.574673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 865/1735] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:13.577763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700ca11-7ac8-48f1-bed1-592648cd8c75 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:13.581513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b700ca11-7ac8-48f1-bed1-592648cd8c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:13.588368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139ecf-bbb4-4ab8-b694-2461b63972fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:13.589593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139ecf-bbb4-4ab8-b694-2461b63972fb service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:13.597815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139ecf-bbb4-4ab8-b694-2461b63972fb service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:13.597815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139ecf-bbb4-4ab8-b694-2461b63972fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:13.652402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18139ecf-bbb4-4ab8-b694-2461b63972fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:13.662308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18139ecf-bbb4-4ab8-b694-2461b63972fb service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:13.676410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700ca11-7ac8-48f1-bed1-592648cd8c75 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:13.696984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 871/1736] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:13.702672 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd548e5c-bafa-416d-9ef4-018bc8d2344e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:13.704910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd548e5c-bafa-416d-9ef4-018bc8d2344e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:13.705204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd548e5c-bafa-416d-9ef4-018bc8d2344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:13.717050 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:13.721637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:13.725359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:13.728475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] PATH_INFO: `/v3/users/cf3f0c17aea64751a6527b72e910abc3` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:13.733421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3f0c17aea64751a6527b72e910abc3)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:13.738885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:13.859258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cd548e5c-bafa-416d-9ef4-018bc8d2344e None None] MFA Rules not processed for user `fb227a145fdd44319f5ccbe762409ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:13.861025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cd548e5c-bafa-416d-9ef4-018bc8d2344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:13.878429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3f0c17aea64751a6527b72e910abc3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:13.898027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3f0c17aea64751a6527b72e910abc3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:13.899475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3f0c17aea64751a6527b72e910abc3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:13.926883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3f0c17aea64751a6527b72e910abc3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:13.927880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3f0c17aea64751a6527b72e910abc3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:13.974062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 866/1737] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:13 2022] DELETE /identity/v3/users/cf3f0c17aea64751a6527b72e910abc3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:13.975543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:13.977321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:14.016173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 872/1738] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:12:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:14.030570 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd548e5c-bafa-416d-9ef4-018bc8d2344e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:14.032917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cd548e5c-bafa-416d-9ef4-018bc8d2344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:14.052024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd548e5c-bafa-416d-9ef4-018bc8d2344e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:14.179542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92924967-f3f7-4c2b-9694-1149fcc279ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:14.180326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92924967-f3f7-4c2b-9694-1149fcc279ad service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:14.180622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92924967-f3f7-4c2b-9694-1149fcc279ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:14.180982 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92924967-f3f7-4c2b-9694-1149fcc279ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:14.187883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82face28-db27-4ed1-933b-1352937cb574 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:14.200460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92924967-f3f7-4c2b-9694-1149fcc279ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:14.200608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f300a97-ad03-4b20-8dd0-ada98226b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:14.201677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300a97-ad03-4b20-8dd0-ada98226b50b admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:14.201971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300a97-ad03-4b20-8dd0-ada98226b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:14.202257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300a97-ad03-4b20-8dd0-ada98226b50b admin admin] PATH_INFO: `/v3/projects/27c298eafd114327ac77b32b2944349f/users/14b7b32f76604ecebda46a71c895fa1a/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:14.204360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92924967-f3f7-4c2b-9694-1149fcc279ad service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:14.232147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 873/1739] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:14.237149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b8ddd-668d-420d-af2e-4905151a628e None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:14.237149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b8ddd-668d-420d-af2e-4905151a628e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:14.237149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b8ddd-668d-420d-af2e-4905151a628e None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:14.240859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f300a97-ad03-4b20-8dd0-ada98226b50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c298eafd114327ac77b32b2944349f, user_id=14b7b32f76604ecebda46a71c895fa1a, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:14.241063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 874/1740] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 13 22:12:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:12:14.242415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd84ab6-4b4b-46d8-ac98-49a5b13d70f2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:14.244867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd84ab6-4b4b-46d8-ac98-49a5b13d70f2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:14.245260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f300a97-ad03-4b20-8dd0-ada98226b50b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:14.245442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd84ab6-4b4b-46d8-ac98-49a5b13d70f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:14.292828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 867/1741] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:13 2022] PUT /identity/v3/projects/27c298eafd114327ac77b32b2944349f/users/14b7b32f76604ecebda46a71c895fa1a/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:14.293858 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f300a97-ad03-4b20-8dd0-ada98226b50b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:14.301818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5f300a97-ad03-4b20-8dd0-ada98226b50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:14.309694 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4bd84ab6-4b4b-46d8-ac98-49a5b13d70f2 None None] MFA Rules not processed for user `fb227a145fdd44319f5ccbe762409ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:14.311004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4bd84ab6-4b4b-46d8-ac98-49a5b13d70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:14.411720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:14.430298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 875/1742] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:12:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:14.443362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a312-c889-4456-87df-c2bf58de6c7b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:14.446191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a312-c889-4456-87df-c2bf58de6c7b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:14.446643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a312-c889-4456-87df-c2bf58de6c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:14.462943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f300a97-ad03-4b20-8dd0-ada98226b50b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:14.478384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c7411-37b1-4231-95ed-56f8c4fad38d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:14.479191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c7411-37b1-4231-95ed-56f8c4fad38d service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:14.479569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c7411-37b1-4231-95ed-56f8c4fad38d service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:14.480015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c7411-37b1-4231-95ed-56f8c4fad38d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:14.482757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b11c7411-37b1-4231-95ed-56f8c4fad38d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:14.564961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e9a2a312-c889-4456-87df-c2bf58de6c7b None None] MFA Rules not processed for user `e5a2ca1c3b1b43cd9c9fe090d2d41cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:14.566240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e9a2a312-c889-4456-87df-c2bf58de6c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:14.626410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:14.650413 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c7411-37b1-4231-95ed-56f8c4fad38d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:14.651877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c7411-37b1-4231-95ed-56f8c4fad38d service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:14.675233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 868/1743] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:14.677995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777ab8a-560f-49d5-bc1f-6172cba779cf None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:14.679955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777ab8a-560f-49d5-bc1f-6172cba779cf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:14.680737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777ab8a-560f-49d5-bc1f-6172cba779cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:14.726422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 876/1744] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:14.726422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2a312-c889-4456-87df-c2bf58de6c7b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:14.728186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e9a2a312-c889-4456-87df-c2bf58de6c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:14.748721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e777ab8a-560f-49d5-bc1f-6172cba779cf None None] MFA Rules not processed for user `14b7b32f76604ecebda46a71c895fa1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:14.754682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e777ab8a-560f-49d5-bc1f-6172cba779cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:14.763760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2a312-c889-4456-87df-c2bf58de6c7b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:14.780320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93ec8b-3955-4d2b-aa75-fb063763b5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:14.781003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93ec8b-3955-4d2b-aa75-fb063763b5da service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:14.781293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93ec8b-3955-4d2b-aa75-fb063763b5da service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:14.781576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93ec8b-3955-4d2b-aa75-fb063763b5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:14.803023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93ec8b-3955-4d2b-aa75-fb063763b5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:14.806412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93ec8b-3955-4d2b-aa75-fb063763b5da service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:14.843080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 877/1745] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:14.844576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93ec8b-3955-4d2b-aa75-fb063763b5da service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:14.846276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3d93ec8b-3955-4d2b-aa75-fb063763b5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:14.891246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 869/1746] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:14.893291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777ab8a-560f-49d5-bc1f-6172cba779cf None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:14.997989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93ec8b-3955-4d2b-aa75-fb063763b5da service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:15.003919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:15.004802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:15.005643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:15.005936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] PATH_INFO: `/v3/projects/012b831aaa6a400582bf2f3e2f56f211` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:15.008019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=012b831aaa6a400582bf2f3e2f56f211)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:15.010134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:15.078682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777ab8a-560f-49d5-bc1f-6172cba779cf None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:15.098881 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac14d6-8ef3-46bc-9a6e-45417af6baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:15.099690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac14d6-8ef3-46bc-9a6e-45417af6baa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:15.102984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac14d6-8ef3-46bc-9a6e-45417af6baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:15.120659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac14d6-8ef3-46bc-9a6e-45417af6baa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:15.123587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac14d6-8ef3-46bc-9a6e-45417af6baa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:15.128887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac14d6-8ef3-46bc-9a6e-45417af6baa2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:15.246230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 870/1747] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:14 2022] POST /identity/v3/projects => generated 407 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:15.247653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac14d6-8ef3-46bc-9a6e-45417af6baa2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:15.261822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012b831aaa6a400582bf2f3e2f56f211', 'request_id': 'req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.270586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:15.278791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012b831aaa6a400582bf2f3e2f56f211', 'request_id': 'req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.322357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012b831aaa6a400582bf2f3e2f56f211', 'request_id': 'req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.358431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] The token cache is being invalidate because project 012b831aaa6a400582bf2f3e2f56f211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:15.358734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.360134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.362442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 878/1748] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:14 2022] DELETE /identity/v3/projects/012b831aaa6a400582bf2f3e2f56f211 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:15.367947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:15.376012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:15.509183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac14d6-8ef3-46bc-9a6e-45417af6baa2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:15.536186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd88559-e518-4017-a5d3-61dbde24e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:15.537114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88559-e518-4017-a5d3-61dbde24e6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:15.540311 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88559-e518-4017-a5d3-61dbde24e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:15.540468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88559-e518-4017-a5d3-61dbde24e6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:15.541107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd88559-e518-4017-a5d3-61dbde24e6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:15.549559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd88559-e518-4017-a5d3-61dbde24e6f5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:15.584760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:15.645855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 871/1749] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:15 2022] POST /identity/v3/users => generated 310 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:15.646784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd88559-e518-4017-a5d3-61dbde24e6f5 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:15.656785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-edd88559-e518-4017-a5d3-61dbde24e6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:15.657557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf6fc4-d4f0-484a-8ec4-c6ec3bff8495 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:15.672620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:15.674426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:15.675938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:15.676365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] PATH_INFO: `/v3/users/35e1226e11a7464a84676eba1b63c8ed` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:15.677972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e1226e11a7464a84676eba1b63c8ed)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:15.682066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:15.852790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e1226e11a7464a84676eba1b63c8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.880656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e1226e11a7464a84676eba1b63c8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.907289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd88559-e518-4017-a5d3-61dbde24e6f5 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:15.925514 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:15.926203 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:15.926429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e1226e11a7464a84676eba1b63c8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.926539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:15.926753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:15.932069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e1226e11a7464a84676eba1b63c8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.935279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e1226e11a7464a84676eba1b63c8ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:15.936916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:15.985600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 879/1750] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:15 2022] DELETE /identity/v3/users/35e1226e11a7464a84676eba1b63c8ed => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:15.989392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:15.994714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:16.224722 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:16.226504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:16.303342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 872/1751] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:16.304988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:16.312117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:16.367643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc782b-6d37-4a14-9d32-40941d6db81b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:16.367849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c3c6-dd53-4d0b-a052-9c236c8459e2 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:16.376642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:16.377597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:16.377991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:16.378470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:16.385448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:16.424140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:16.427999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:16.467999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 880/1752] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:16.468995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:16.474759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:16.480182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:16.587754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a901de-3809-4dc4-b6f3-fcd8e85e096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:16.588546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a901de-3809-4dc4-b6f3-fcd8e85e096e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:16.588919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a901de-3809-4dc4-b6f3-fcd8e85e096e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:16.589210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a901de-3809-4dc4-b6f3-fcd8e85e096e admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:16.589953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a901de-3809-4dc4-b6f3-fcd8e85e096e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:16.591729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a901de-3809-4dc4-b6f3-fcd8e85e096e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:16.624915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 873/1753] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:16.629714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a901de-3809-4dc4-b6f3-fcd8e85e096e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:16.636230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-07a901de-3809-4dc4-b6f3-fcd8e85e096e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:16.682081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a901de-3809-4dc4-b6f3-fcd8e85e096e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:16.703337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:16.707727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab08ff-4ddd-42c9-af98-2b9be5402b5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:16.708620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab08ff-4ddd-42c9-af98-2b9be5402b5c service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:16.709169 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab08ff-4ddd-42c9-af98-2b9be5402b5c service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:16.709451 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab08ff-4ddd-42c9-af98-2b9be5402b5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:16.757344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab08ff-4ddd-42c9-af98-2b9be5402b5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:16.758947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab08ff-4ddd-42c9-af98-2b9be5402b5c service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:16.790919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b1387-1aed-42ba-9431-6604bc27d325 service placement] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:16.822075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 874/1754] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:16.823059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab08ff-4ddd-42c9-af98-2b9be5402b5c service placement] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:16.836410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5dab08ff-4ddd-42c9-af98-2b9be5402b5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:16.838321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:16.839000 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:16.839287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:16.844300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:16.860808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:16.894553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab08ff-4ddd-42c9-af98-2b9be5402b5c service placement] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:16.913460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:16.917590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:16.918316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:16.922975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] PATH_INFO: `/v3/projects/b3bac4b795c84e1bb6ea8f838eeb3596` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:16.926963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3bac4b795c84e1bb6ea8f838eeb3596)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:16.929646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:17.172783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:17.181349 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:17.186363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3bac4b795c84e1bb6ea8f838eeb3596', 'request_id': 'req-b88fc724-73a2-47bd-9d82-f458bbc76fde'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:17.217747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3bac4b795c84e1bb6ea8f838eeb3596', 'request_id': 'req-b88fc724-73a2-47bd-9d82-f458bbc76fde'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:17.230870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3bac4b795c84e1bb6ea8f838eeb3596', 'request_id': 'req-b88fc724-73a2-47bd-9d82-f458bbc76fde'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:17.245433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 881/1755] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:17.246764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:17.254649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:17.272086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] The token cache is being invalidate because project b3bac4b795c84e1bb6ea8f838eeb3596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:17.274107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:17.278486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b88fc724-73a2-47bd-9d82-f458bbc76fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:17.290326 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 875/1756] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:16 2022] DELETE /identity/v3/projects/b3bac4b795c84e1bb6ea8f838eeb3596 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:17.294699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e95f5-9b6d-4591-9525-44849ee2ce69 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:17.295173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e95f5-9b6d-4591-9525-44849ee2ce69 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:17.296583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e95f5-9b6d-4591-9525-44849ee2ce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:17.330433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef08d9-0c93-47a5-ae71-e0c30a3d106a service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:17.365551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-162e95f5-9b6d-4591-9525-44849ee2ce69 None None] MFA Rules not processed for user `966f641526b64cf3aec1744a141a2f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:17.373223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-162e95f5-9b6d-4591-9525-44849ee2ce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:17.529909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfcd46-ce11-41c2-90e7-0cf052331dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:17.534526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfcd46-ce11-41c2-90e7-0cf052331dec admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:17.536281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfcd46-ce11-41c2-90e7-0cf052331dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:17.536726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfcd46-ce11-41c2-90e7-0cf052331dec admin admin] PATH_INFO: `/v3/projects/5e779ab4512c49c29231a72043800ec0/users/0aeafff56f734d80b0845a6916e5ebee/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:17.597710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfcd46-ce11-41c2-90e7-0cf052331dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e779ab4512c49c29231a72043800ec0, user_id=0aeafff56f734d80b0845a6916e5ebee, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:17.603365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfcd46-ce11-41c2-90e7-0cf052331dec admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:17.649558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 882/1757] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:17 2022] PUT /identity/v3/projects/5e779ab4512c49c29231a72043800ec0/users/0aeafff56f734d80b0845a6916e5ebee/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:17.657196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09267d91-4755-44d6-8906-f97bb54181ee None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:17.657498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09267d91-4755-44d6-8906-f97bb54181ee None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:17.660170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09267d91-4755-44d6-8906-f97bb54181ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:17.729005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-09267d91-4755-44d6-8906-f97bb54181ee None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:17.734785 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-09267d91-4755-44d6-8906-f97bb54181ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:17.758153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 876/1758] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:17.759834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e95f5-9b6d-4591-9525-44849ee2ce69 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:17.780110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-162e95f5-9b6d-4591-9525-44849ee2ce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:17.840386 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e95f5-9b6d-4591-9525-44849ee2ce69 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:18.027534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:18.080263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 883/1759] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:18.083555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d58f-18b8-446e-a2f1-3b9960a980a2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:18.086985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d58f-18b8-446e-a2f1-3b9960a980a2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:18.087832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d58f-18b8-446e-a2f1-3b9960a980a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:18.122733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05552ef-9481-44ef-9579-1149123ccb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:18.128170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05552ef-9481-44ef-9579-1149123ccb63 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:18.129500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05552ef-9481-44ef-9579-1149123ccb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:18.129803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05552ef-9481-44ef-9579-1149123ccb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:18.130614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05552ef-9481-44ef-9579-1149123ccb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:18.132510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05552ef-9481-44ef-9579-1149123ccb63 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:18.135320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b5b7d58f-18b8-446e-a2f1-3b9960a980a2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:18.149328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b5b7d58f-18b8-446e-a2f1-3b9960a980a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:18.178179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 884/1760] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:18.182818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d58f-18b8-446e-a2f1-3b9960a980a2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:18.199658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 877/1761] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:18.210000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05552ef-9481-44ef-9579-1149123ccb63 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:18.210926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d58f-18b8-446e-a2f1-3b9960a980a2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:18.220811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:18.234937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38448b9-acc0-4a64-a363-7a41ff88344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:18.236069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38448b9-acc0-4a64-a363-7a41ff88344b admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:18.236510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38448b9-acc0-4a64-a363-7a41ff88344b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:18.236933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38448b9-acc0-4a64-a363-7a41ff88344b admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:18.238168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38448b9-acc0-4a64-a363-7a41ff88344b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:18.241891 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38448b9-acc0-4a64-a363-7a41ff88344b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:18.244602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05552ef-9481-44ef-9579-1149123ccb63 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:18.248295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38448b9-acc0-4a64-a363-7a41ff88344b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:18.273967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a40904-1b8a-45ca-8efb-a1e664440caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:18.275817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40904-1b8a-45ca-8efb-a1e664440caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:18.277890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40904-1b8a-45ca-8efb-a1e664440caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:18.278417 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40904-1b8a-45ca-8efb-a1e664440caa admin admin] PATH_INFO: `/v3/projects/5e779ab4512c49c29231a72043800ec0/users/0aeafff56f734d80b0845a6916e5ebee/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:18.289906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40904-1b8a-45ca-8efb-a1e664440caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e779ab4512c49c29231a72043800ec0, user_id=0aeafff56f734d80b0845a6916e5ebee, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:18.293158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40904-1b8a-45ca-8efb-a1e664440caa admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:18.312943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 885/1762] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:18.318750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38448b9-acc0-4a64-a363-7a41ff88344b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:18.342573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 878/1763] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:18 2022] PUT /identity/v3/projects/5e779ab4512c49c29231a72043800ec0/users/0aeafff56f734d80b0845a6916e5ebee/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:18.356720 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc309-da49-4337-8ef5-ba0d5f85c292 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:18.357060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38448b9-acc0-4a64-a363-7a41ff88344b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:18.357691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc309-da49-4337-8ef5-ba0d5f85c292 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:18.358927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc309-da49-4337-8ef5-ba0d5f85c292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:18.409259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4e3cc309-da49-4337-8ef5-ba0d5f85c292 None None] MFA Rules not processed for user `0aeafff56f734d80b0845a6916e5ebee`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:18.414799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4e3cc309-da49-4337-8ef5-ba0d5f85c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:18.603774 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d65cf-40e1-408c-9a7c-827d80c0c378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:18.605744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d65cf-40e1-408c-9a7c-827d80c0c378 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:18.606049 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d65cf-40e1-408c-9a7c-827d80c0c378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:18.606340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d65cf-40e1-408c-9a7c-827d80c0c378 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:18.609733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d65cf-40e1-408c-9a7c-827d80c0c378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:18.613334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d65cf-40e1-408c-9a7c-827d80c0c378 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:18.648530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 879/1764] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:18 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:18.661354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc309-da49-4337-8ef5-ba0d5f85c292 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:18.664041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4e3cc309-da49-4337-8ef5-ba0d5f85c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:18.692505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 886/1765] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:18 2022] POST /identity/v3/projects => generated 369 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:18.693617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d65cf-40e1-408c-9a7c-827d80c0c378 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:18.875682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc309-da49-4337-8ef5-ba0d5f85c292 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:18.941571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d65cf-40e1-408c-9a7c-827d80c0c378 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:18.986447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871de990-a39a-4634-9ebc-01b971471033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:18.989827 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871de990-a39a-4634-9ebc-01b971471033 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:18.993338 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871de990-a39a-4634-9ebc-01b971471033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:18.996620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871de990-a39a-4634-9ebc-01b971471033 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:19.021498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871de990-a39a-4634-9ebc-01b971471033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:19.032018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871de990-a39a-4634-9ebc-01b971471033 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:19.137354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f3b80-0e18-4878-a18a-4e906359ac0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:19.140121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3b80-0e18-4878-a18a-4e906359ac0e service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:19.140671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3b80-0e18-4878-a18a-4e906359ac0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:19.141011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3b80-0e18-4878-a18a-4e906359ac0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:19.141261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 887/1766] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:18 2022] POST /identity/v3/users => generated 285 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:19.147242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871de990-a39a-4634-9ebc-01b971471033 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:19.178125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871de990-a39a-4634-9ebc-01b971471033 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:19.196277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef39fe-196e-48fe-8e51-5d03f169052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:19.196923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef39fe-196e-48fe-8e51-5d03f169052b admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:19.199513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef39fe-196e-48fe-8e51-5d03f169052b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:19.199925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef39fe-196e-48fe-8e51-5d03f169052b admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:19.204396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef39fe-196e-48fe-8e51-5d03f169052b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:19.209068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef39fe-196e-48fe-8e51-5d03f169052b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:19.213626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:19.266798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 888/1767] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:19.269010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef39fe-196e-48fe-8e51-5d03f169052b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:19.309061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef39fe-196e-48fe-8e51-5d03f169052b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:19.338751 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3d397-cae3-4234-8142-8c3bf2719dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:19.339464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3d397-cae3-4234-8142-8c3bf2719dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:19.339755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3d397-cae3-4234-8142-8c3bf2719dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:19.342203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3d397-cae3-4234-8142-8c3bf2719dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:19.343104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3d397-cae3-4234-8142-8c3bf2719dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:19.349130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3d397-cae3-4234-8142-8c3bf2719dd4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:19.402742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 889/1768] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:19.402925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f3b80-0e18-4878-a18a-4e906359ac0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:19.403686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f3b80-0e18-4878-a18a-4e906359ac0e service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:19.404964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3d397-cae3-4234-8142-8c3bf2719dd4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:19.420839 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 880/1769] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:18 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 761 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:19.433331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3d397-cae3-4234-8142-8c3bf2719dd4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:19.456365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24edde8-3072-4b6f-b211-cdad92e2adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:19.457298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24edde8-3072-4b6f-b211-cdad92e2adae admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:19.457583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24edde8-3072-4b6f-b211-cdad92e2adae admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:19.457865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24edde8-3072-4b6f-b211-cdad92e2adae admin admin] PATH_INFO: `/v3/projects/54e383d83d45400a9aec057396b97984/users/b228a87c58684789b75e67615a26bbc3/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:19.508182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24edde8-3072-4b6f-b211-cdad92e2adae admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e383d83d45400a9aec057396b97984, user_id=b228a87c58684789b75e67615a26bbc3, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:19.514499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24edde8-3072-4b6f-b211-cdad92e2adae admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:19.568024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 890/1770] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:19 2022] PUT /identity/v3/projects/54e383d83d45400a9aec057396b97984/users/b228a87c58684789b75e67615a26bbc3/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:19.582083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0382-bbf8-4e9b-8caa-afb5407db023 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:19.582667 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0382-bbf8-4e9b-8caa-afb5407db023 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:19.583241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0382-bbf8-4e9b-8caa-afb5407db023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:19.637488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-18ec0382-bbf8-4e9b-8caa-afb5407db023 None None] MFA Rules not processed for user `b228a87c58684789b75e67615a26bbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:19.639458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-18ec0382-bbf8-4e9b-8caa-afb5407db023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:19.784269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 881/1771] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:19.789192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24edde8-3072-4b6f-b211-cdad92e2adae admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:19.825408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:19.887372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0382-bbf8-4e9b-8caa-afb5407db023 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:19.939125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24edde8-3072-4b6f-b211-cdad92e2adae admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:19.950911 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05932ac-796a-453f-8f8d-a2de3420a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:19.952618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05932ac-796a-453f-8f8d-a2de3420a20a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:19.953157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05932ac-796a-453f-8f8d-a2de3420a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:19.955213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05932ac-796a-453f-8f8d-a2de3420a20a admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:19.958123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05932ac-796a-453f-8f8d-a2de3420a20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:19.965070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05932ac-796a-453f-8f8d-a2de3420a20a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:20.014491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0382-bbf8-4e9b-8caa-afb5407db023 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:20.028622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 891/1772] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:19 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:20.037999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05932ac-796a-453f-8f8d-a2de3420a20a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:20.039291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ac956-f9f5-4846-8a9c-02f4f2fc70b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:20.040430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac956-f9f5-4846-8a9c-02f4f2fc70b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:20.042491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac956-f9f5-4846-8a9c-02f4f2fc70b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:20.042783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac956-f9f5-4846-8a9c-02f4f2fc70b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:20.048692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-605ac956-f9f5-4846-8a9c-02f4f2fc70b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:20.176038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ac956-f9f5-4846-8a9c-02f4f2fc70b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:20.179313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ac956-f9f5-4846-8a9c-02f4f2fc70b3 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:20.186365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:20.203363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 882/1773] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:20.255844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05932ac-796a-453f-8f8d-a2de3420a20a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:20.264525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2de07-85d6-4e7f-ade0-13c206f9a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:20.265489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2de07-85d6-4e7f-ade0-13c206f9a7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:20.265992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2de07-85d6-4e7f-ade0-13c206f9a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:20.267359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2de07-85d6-4e7f-ade0-13c206f9a7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:20.268448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2de07-85d6-4e7f-ade0-13c206f9a7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:20.274244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2de07-85d6-4e7f-ade0-13c206f9a7f7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:20.316418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 892/1774] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:20 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:20.321001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ac956-f9f5-4846-8a9c-02f4f2fc70b3 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:20.366055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ac956-f9f5-4846-8a9c-02f4f2fc70b3 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:20.393529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8707089-d320-45d9-a11f-cc9b7ee14b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:20.394511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8707089-d320-45d9-a11f-cc9b7ee14b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:20.395663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8707089-d320-45d9-a11f-cc9b7ee14b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:20.396362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8707089-d320-45d9-a11f-cc9b7ee14b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:20.397615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8707089-d320-45d9-a11f-cc9b7ee14b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:20.400110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8707089-d320-45d9-a11f-cc9b7ee14b20 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:20.433480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 883/1775] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:12:20.436646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2de07-85d6-4e7f-ade0-13c206f9a7f7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:20.462992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2de07-85d6-4e7f-ade0-13c206f9a7f7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:20.502410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda67c97-ff5d-4c6b-aba0-794b27531762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:20.503192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda67c97-ff5d-4c6b-aba0-794b27531762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:20.503488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda67c97-ff5d-4c6b-aba0-794b27531762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:20.503773 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda67c97-ff5d-4c6b-aba0-794b27531762 admin admin] PATH_INFO: `/v3/projects/fb06e5ae3dff4180a80bb90833206263/users/46d06b8197d84141b55755f74be8cc25/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:20.546552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda67c97-ff5d-4c6b-aba0-794b27531762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb06e5ae3dff4180a80bb90833206263, user_id=46d06b8197d84141b55755f74be8cc25, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:20.556305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda67c97-ff5d-4c6b-aba0-794b27531762 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:20.613826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 893/1776] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:20 2022] PUT /identity/v3/projects/fb06e5ae3dff4180a80bb90833206263/users/46d06b8197d84141b55755f74be8cc25/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:20.618803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8707089-d320-45d9-a11f-cc9b7ee14b20 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:20.635132 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8707089-d320-45d9-a11f-cc9b7ee14b20 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:20.862442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc213-d32e-4cd8-b25c-20b7a4dff0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:20.867377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc213-d32e-4cd8-b25c-20b7a4dff0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:20.868583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc213-d32e-4cd8-b25c-20b7a4dff0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:20.869366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc213-d32e-4cd8-b25c-20b7a4dff0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:20.873464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbc213-d32e-4cd8-b25c-20b7a4dff0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:20.882568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbc213-d32e-4cd8-b25c-20b7a4dff0d2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:20.885301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda67c97-ff5d-4c6b-aba0-794b27531762 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:20.971996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 884/1777] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:20.974099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc213-d32e-4cd8-b25c-20b7a4dff0d2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:21.023734 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc213-d32e-4cd8-b25c-20b7a4dff0d2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:21.042269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf9804-a540-4234-a74d-ddc0d55655e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:21.048129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf9804-a540-4234-a74d-ddc0d55655e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:21.049730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf9804-a540-4234-a74d-ddc0d55655e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:21.050196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf9804-a540-4234-a74d-ddc0d55655e2 admin admin] PATH_INFO: `/v3/projects/fb06e5ae3dff4180a80bb90833206263/users/46d06b8197d84141b55755f74be8cc25/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:21.057774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf9804-a540-4234-a74d-ddc0d55655e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb06e5ae3dff4180a80bb90833206263, user_id=46d06b8197d84141b55755f74be8cc25, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:21.080956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf9804-a540-4234-a74d-ddc0d55655e2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:21.109949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda67c97-ff5d-4c6b-aba0-794b27531762 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:21.144392 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 885/1778] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:20 2022] PUT /identity/v3/projects/fb06e5ae3dff4180a80bb90833206263/users/46d06b8197d84141b55755f74be8cc25/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:21.155873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f96cb-b487-4b22-8b7d-d684dd10c6cd None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:21.156640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f96cb-b487-4b22-8b7d-d684dd10c6cd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:21.157768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f96cb-b487-4b22-8b7d-d684dd10c6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:21.160120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:21.255699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:21.257021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:21.257676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:21.258029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:21.263369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:21.280741 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-cc8f96cb-b487-4b22-8b7d-d684dd10c6cd None None] MFA Rules not processed for user `46d06b8197d84141b55755f74be8cc25`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:21.281997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cc8f96cb-b487-4b22-8b7d-d684dd10c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:21.509920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:21.511404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:21.587990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 894/1779] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:21.627090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:21.628417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:21.648764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 886/1780] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:21.667537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f96cb-b487-4b22-8b7d-d684dd10c6cd None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:21.678913 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cc8f96cb-b487-4b22-8b7d-d684dd10c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:21.765306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f96cb-b487-4b22-8b7d-d684dd10c6cd None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:21.789830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698bdf5-f069-49d7-9d56-23a4b8f2b649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:21.790521 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698bdf5-f069-49d7-9d56-23a4b8f2b649 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:21.790808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698bdf5-f069-49d7-9d56-23a4b8f2b649 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:21.791085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698bdf5-f069-49d7-9d56-23a4b8f2b649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:21.832926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698bdf5-f069-49d7-9d56-23a4b8f2b649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:21.834745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698bdf5-f069-49d7-9d56-23a4b8f2b649 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:21.872555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 887/1781] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:21.925764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61cda9-91f4-4eae-8e16-2bf27e6fda8e service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:21.968367 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:21.972151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:21.974677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:21.977472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] PATH_INFO: `/v3/users/f78da04a11f94b00b0e3a1f07b42fe02` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:21.993167 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78da04a11f94b00b0e3a1f07b42fe02)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:22.003111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:22.045333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef0bf-b567-43ca-982b-e6443e11f173 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:22.046236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef0bf-b567-43ca-982b-e6443e11f173 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:22.046661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef0bf-b567-43ca-982b-e6443e11f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:22.152580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78da04a11f94b00b0e3a1f07b42fe02'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:22.180571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78da04a11f94b00b0e3a1f07b42fe02'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:22.201042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1feef0bf-b567-43ca-982b-e6443e11f173 None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:22.202852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1feef0bf-b567-43ca-982b-e6443e11f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:22.226912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78da04a11f94b00b0e3a1f07b42fe02'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:22.229005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78da04a11f94b00b0e3a1f07b42fe02'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:22.231045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-781f2b99-7873-432f-bb4e-f516b4a6a476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78da04a11f94b00b0e3a1f07b42fe02'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:22.234887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:22.259777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:22.277388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 895/1782] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:21 2022] DELETE /identity/v3/users/f78da04a11f94b00b0e3a1f07b42fe02 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:22.281764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82144e61-c57d-42b3-9ffc-cdf7ed30b47f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:22.282247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82144e61-c57d-42b3-9ffc-cdf7ed30b47f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:22.282535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82144e61-c57d-42b3-9ffc-cdf7ed30b47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:22.330464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-82144e61-c57d-42b3-9ffc-cdf7ed30b47f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:22.335002 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-82144e61-c57d-42b3-9ffc-cdf7ed30b47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:22.501460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 888/1783] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:12:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:22.541703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 896/1784] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:22.596602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feef0bf-b567-43ca-982b-e6443e11f173 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:22.602719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1feef0bf-b567-43ca-982b-e6443e11f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:22.735626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82144e61-c57d-42b3-9ffc-cdf7ed30b47f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:22.737520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-82144e61-c57d-42b3-9ffc-cdf7ed30b47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:22.874120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feef0bf-b567-43ca-982b-e6443e11f173 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:22.921511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82144e61-c57d-42b3-9ffc-cdf7ed30b47f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:22.934583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8727c13-f394-4f56-a47c-85e0bc7f62d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:22.935384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8727c13-f394-4f56-a47c-85e0bc7f62d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:22.935742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8727c13-f394-4f56-a47c-85e0bc7f62d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:22.936120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8727c13-f394-4f56-a47c-85e0bc7f62d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:22.938555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d8727c13-f394-4f56-a47c-85e0bc7f62d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:23.027369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e533bc-541c-4158-a3a9-5cdc02a638b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:23.030276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e533bc-541c-4158-a3a9-5cdc02a638b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:23.031266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e533bc-541c-4158-a3a9-5cdc02a638b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:23.031478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e533bc-541c-4158-a3a9-5cdc02a638b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:23.057666 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e533bc-541c-4158-a3a9-5cdc02a638b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:23.060438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e533bc-541c-4158-a3a9-5cdc02a638b9 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:23.095995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 889/1785] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:23.097597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e533bc-541c-4158-a3a9-5cdc02a638b9 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:23.099446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-08e533bc-541c-4158-a3a9-5cdc02a638b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:23.183715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8727c13-f394-4f56-a47c-85e0bc7f62d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:23.192842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8727c13-f394-4f56-a47c-85e0bc7f62d7 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:23.230015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 897/1786] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:23.258418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:23.270445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e533bc-541c-4158-a3a9-5cdc02a638b9 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:23.277061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef499e2-2096-4e9b-8706-d914edf0e6b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:23.278304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef499e2-2096-4e9b-8706-d914edf0e6b9 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:23.278449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef499e2-2096-4e9b-8706-d914edf0e6b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:23.278865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef499e2-2096-4e9b-8706-d914edf0e6b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:23.444847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef499e2-2096-4e9b-8706-d914edf0e6b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:23.446167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef499e2-2096-4e9b-8706-d914edf0e6b9 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:23.473312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 890/1787] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:12:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:12:25.246989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae01a9e-f3d1-4a37-8fd8-4cc1e2f10e67 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:25.246989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae01a9e-f3d1-4a37-8fd8-4cc1e2f10e67 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:25.247740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae01a9e-f3d1-4a37-8fd8-4cc1e2f10e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:25.300484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8ae01a9e-f3d1-4a37-8fd8-4cc1e2f10e67 None None] MFA Rules not processed for user `e5a2ca1c3b1b43cd9c9fe090d2d41cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:25.301996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8ae01a9e-f3d1-4a37-8fd8-4cc1e2f10e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:25.558684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:25.577583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168b4a3-b0e3-41ae-ab3d-af492bf94995 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:25.578125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168b4a3-b0e3-41ae-ab3d-af492bf94995 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:25.578229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168b4a3-b0e3-41ae-ab3d-af492bf94995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:25.641571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 898/1788] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:25.659404 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0168b4a3-b0e3-41ae-ab3d-af492bf94995 None None] MFA Rules not processed for user `fb227a145fdd44319f5ccbe762409ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:25.675154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0168b4a3-b0e3-41ae-ab3d-af492bf94995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:25.699372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 891/1789] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jul 13 22:12:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:25.795499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae01a9e-f3d1-4a37-8fd8-4cc1e2f10e67 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:25.801579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8ae01a9e-f3d1-4a37-8fd8-4cc1e2f10e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:25.840139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae93fbe-7fe4-4eaa-a340-89b1bbf0ded2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:25.841004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae93fbe-7fe4-4eaa-a340-89b1bbf0ded2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:25.842107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae93fbe-7fe4-4eaa-a340-89b1bbf0ded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:25.872347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae01a9e-f3d1-4a37-8fd8-4cc1e2f10e67 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:25.891308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343837ae-67fa-47e2-a6b0-8eb6532e2075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:25.898458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343837ae-67fa-47e2-a6b0-8eb6532e2075 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:25.899604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343837ae-67fa-47e2-a6b0-8eb6532e2075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:25.900155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343837ae-67fa-47e2-a6b0-8eb6532e2075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:25.911048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4ae93fbe-7fe4-4eaa-a340-89b1bbf0ded2 None None] MFA Rules not processed for user `71516217b1714e84bda9e584c97e84b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:25.917699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4ae93fbe-7fe4-4eaa-a340-89b1bbf0ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:25.936811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343837ae-67fa-47e2-a6b0-8eb6532e2075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:25.938266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343837ae-67fa-47e2-a6b0-8eb6532e2075 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:25.972990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 899/1790] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:26.183398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 892/1791] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:26.258319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343837ae-67fa-47e2-a6b0-8eb6532e2075 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:26.259829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-343837ae-67fa-47e2-a6b0-8eb6532e2075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:26.288515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343837ae-67fa-47e2-a6b0-8eb6532e2075 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:26.304369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:26.305263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:26.305553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:26.305827 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] PATH_INFO: `/v3/users/5056b4d0aa554ecd89511dd83bf59472` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:26.308630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5056b4d0aa554ecd89511dd83bf59472)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:26.310745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:26.489412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5056b4d0aa554ecd89511dd83bf59472'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:26.516545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5056b4d0aa554ecd89511dd83bf59472'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:26.573351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5056b4d0aa554ecd89511dd83bf59472'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:26.574994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5056b4d0aa554ecd89511dd83bf59472'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:26.577545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5056b4d0aa554ecd89511dd83bf59472'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:26.629313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 900/1792] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:26 2022] DELETE /identity/v3/users/5056b4d0aa554ecd89511dd83bf59472 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:26.635248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270db2e-7b85-4ae4-b01c-529fbe60dc58 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:26.635806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270db2e-7b85-4ae4-b01c-529fbe60dc58 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:26.635935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270db2e-7b85-4ae4-b01c-529fbe60dc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:26.696969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4270db2e-7b85-4ae4-b01c-529fbe60dc58 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:26.704658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4270db2e-7b85-4ae4-b01c-529fbe60dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:26.950345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 893/1793] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:27.141954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:27.143831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:27.245019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e508-c705-44cf-b800-35ed1833210b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:27.250964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d42cc-0574-4f5e-aca0-103e709044f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:27.251930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d42cc-0574-4f5e-aca0-103e709044f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:27.252229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d42cc-0574-4f5e-aca0-103e709044f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:27.253457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d42cc-0574-4f5e-aca0-103e709044f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:27.265527 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d42cc-0574-4f5e-aca0-103e709044f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:27.268549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d42cc-0574-4f5e-aca0-103e709044f2 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:27.304812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 901/1794] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:27.343841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270db2e-7b85-4ae4-b01c-529fbe60dc58 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:27.345595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4270db2e-7b85-4ae4-b01c-529fbe60dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:27.373595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270db2e-7b85-4ae4-b01c-529fbe60dc58 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:27.380019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:27.380636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:27.380928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:27.381422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] PATH_INFO: `/v3/projects/4cacd535634e4edca070e4e8894dce21` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:27.383086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cacd535634e4edca070e4e8894dce21)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:27.385270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:27.467150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:27.497208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cacd535634e4edca070e4e8894dce21', 'request_id': 'req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:27.513321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cacd535634e4edca070e4e8894dce21', 'request_id': 'req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:27.531809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cacd535634e4edca070e4e8894dce21', 'request_id': 'req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:27.570410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] The token cache is being invalidate because project 4cacd535634e4edca070e4e8894dce21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:27.570731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:27.571372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:27.573178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 894/1795] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:27 2022] DELETE /identity/v3/projects/4cacd535634e4edca070e4e8894dce21 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:27.576965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d42cc-0574-4f5e-aca0-103e709044f2 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:27.587427 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d42cc-0574-4f5e-aca0-103e709044f2 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:27.722324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:27.723295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:27.723577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:27.723973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] PATH_INFO: `/v3/users/ee34586622b44ccb8983bbb260be8066` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:27.726773 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee34586622b44ccb8983bbb260be8066)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:27.729554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:27.735546 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:27.877475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee34586622b44ccb8983bbb260be8066'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:27.921110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee34586622b44ccb8983bbb260be8066'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:28.003202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee34586622b44ccb8983bbb260be8066'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:28.007983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee34586622b44ccb8983bbb260be8066'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:28.010086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bc4b6ea6-dd31-4f44-b108-69e3dcf4fbe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee34586622b44ccb8983bbb260be8066'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:28.052145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 902/1796] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:27 2022] DELETE /identity/v3/users/ee34586622b44ccb8983bbb260be8066 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:28.092493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:28.100504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:28.129288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d08e4-00e9-4e82-9ce2-e1bceaed574a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:28.418446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:28.432145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:28.432968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:28.433678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] PATH_INFO: `/v3/users/14b7b32f76604ecebda46a71c895fa1a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:28.435626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b7b32f76604ecebda46a71c895fa1a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:28.438235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:28.581613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b7b32f76604ecebda46a71c895fa1a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:28.654584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b7b32f76604ecebda46a71c895fa1a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:28.655508 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b7b32f76604ecebda46a71c895fa1a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:28.718046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b7b32f76604ecebda46a71c895fa1a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:28.720661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b7b32f76604ecebda46a71c895fa1a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:28.766333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 895/1797] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:28 2022] DELETE /identity/v3/users/14b7b32f76604ecebda46a71c895fa1a => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:28.771325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9dd3f-a647-4ec5-9d7b-12af1b1a3c4d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:28.772715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9dd3f-a647-4ec5-9d7b-12af1b1a3c4d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:28.773161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9dd3f-a647-4ec5-9d7b-12af1b1a3c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:28.829196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-64b9dd3f-a647-4ec5-9d7b-12af1b1a3c4d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:28.830491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-64b9dd3f-a647-4ec5-9d7b-12af1b1a3c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:29.148220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 903/1798] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:29.171802 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:29.173850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:29.355020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:29.384525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02708700-be68-4792-9ff4-0fc012c0740e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:29.400493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa5c2-1c0a-480e-98b2-2ad37705670e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:29.401438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa5c2-1c0a-480e-98b2-2ad37705670e service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:29.401995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa5c2-1c0a-480e-98b2-2ad37705670e service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:29.410022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa5c2-1c0a-480e-98b2-2ad37705670e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:29.449836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa5c2-1c0a-480e-98b2-2ad37705670e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:29.454203 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa5c2-1c0a-480e-98b2-2ad37705670e service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:29.489474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 896/1799] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:30.606013 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9dd3f-a647-4ec5-9d7b-12af1b1a3c4d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:30.607627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-64b9dd3f-a647-4ec5-9d7b-12af1b1a3c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:30.628743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9dd3f-a647-4ec5-9d7b-12af1b1a3c4d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:30.661772 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:30.664245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:30.669834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:30.670008 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] PATH_INFO: `/v3/projects/890c779caf114ded87bb205f33bf6f3a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:30.673566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890c779caf114ded87bb205f33bf6f3a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:30.675994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:30.873715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890c779caf114ded87bb205f33bf6f3a', 'request_id': 'req-3e39ed04-98b9-4446-9e33-924d58d25e97'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:30.894731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890c779caf114ded87bb205f33bf6f3a', 'request_id': 'req-3e39ed04-98b9-4446-9e33-924d58d25e97'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:30.917632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890c779caf114ded87bb205f33bf6f3a', 'request_id': 'req-3e39ed04-98b9-4446-9e33-924d58d25e97'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:30.939815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9dd6c-76e1-4367-92d8-4ea76eea9a69 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:30.941474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9dd6c-76e1-4367-92d8-4ea76eea9a69 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:30.941474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9dd6c-76e1-4367-92d8-4ea76eea9a69 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:30.943298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 897/1800] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:12:30.960582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] The token cache is being invalidate because project 890c779caf114ded87bb205f33bf6f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:30.961420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:30.962394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3e39ed04-98b9-4446-9e33-924d58d25e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:30.973370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9dd6c-76e1-4367-92d8-4ea76eea9a69 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:30.975574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3ef9dd6c-76e1-4367-92d8-4ea76eea9a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:30.987622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 904/1801] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:30 2022] DELETE /identity/v3/projects/890c779caf114ded87bb205f33bf6f3a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:31.023452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca877749-3146-41b6-bf17-65072f34ccf6 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:31.024001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca877749-3146-41b6-bf17-65072f34ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:31.024790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca877749-3146-41b6-bf17-65072f34ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:31.062036 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:31.125778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ca877749-3146-41b6-bf17-65072f34ccf6 None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:31.130208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ca877749-3146-41b6-bf17-65072f34ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:31.304680 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9dd6c-76e1-4367-92d8-4ea76eea9a69 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:31.315967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:31.317026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:31.317315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:31.317611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] PATH_INFO: `/v3/users/077942b9e78c41d3b2651db93861d658` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:31.337124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=077942b9e78c41d3b2651db93861d658)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:31.339125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:31.385761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 905/1802] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:12:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:31.387420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca877749-3146-41b6-bf17-65072f34ccf6 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:31.396098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ca877749-3146-41b6-bf17-65072f34ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:31.465577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca877749-3146-41b6-bf17-65072f34ccf6 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:31.499407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077942b9e78c41d3b2651db93861d658'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.512966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:31.514946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077942b9e78c41d3b2651db93861d658'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.515861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077942b9e78c41d3b2651db93861d658'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.518518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:31.523020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:31.525961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] PATH_INFO: `/v3/projects/ccd1e2595c0045c6a5cbbf7025281339` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:31.533721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd1e2595c0045c6a5cbbf7025281339)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:31.546405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:31.550786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077942b9e78c41d3b2651db93861d658'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.552293 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7cd059a3-a45e-496c-986f-7a0cf054bc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077942b9e78c41d3b2651db93861d658'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.588848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 898/1803] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:30 2022] DELETE /identity/v3/users/077942b9e78c41d3b2651db93861d658 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:31.590451 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188e45-d002-44ca-bf08-3bac709fe694 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:31.590825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188e45-d002-44ca-bf08-3bac709fe694 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:31.591182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188e45-d002-44ca-bf08-3bac709fe694 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:31.593557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 899/1804] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:12:31.594560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7188e45-d002-44ca-bf08-3bac709fe694 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:31.598845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f7188e45-d002-44ca-bf08-3bac709fe694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:31.756046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:31.792347 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7188e45-d002-44ca-bf08-3bac709fe694 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:31.822516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd1e2595c0045c6a5cbbf7025281339', 'request_id': 'req-3be6ea28-751d-4f82-bff5-faba40e4eaee'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.835592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd1e2595c0045c6a5cbbf7025281339', 'request_id': 'req-3be6ea28-751d-4f82-bff5-faba40e4eaee'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.851801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd1e2595c0045c6a5cbbf7025281339', 'request_id': 'req-3be6ea28-751d-4f82-bff5-faba40e4eaee'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.880967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] The token cache is being invalidate because project ccd1e2595c0045c6a5cbbf7025281339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:31.881617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.882472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3be6ea28-751d-4f82-bff5-faba40e4eaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:31.886338 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 906/1805] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:31 2022] DELETE /identity/v3/projects/ccd1e2595c0045c6a5cbbf7025281339 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:31.891409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201182-f99f-41e1-9ded-e0075ec866ab None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:31.891875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201182-f99f-41e1-9ded-e0075ec866ab None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:31.893415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201182-f99f-41e1-9ded-e0075ec866ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:31.927402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:31.929150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:31.929350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:31.929738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:31.931855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:31.947924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:31.949998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:31.970916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-21201182-f99f-41e1-9ded-e0075ec866ab None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:31.975400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-21201182-f99f-41e1-9ded-e0075ec866ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:31.976250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 900/1806] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:31.977935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:31.981069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:32.146413 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151abdd1-fec7-4748-be40-d981038b11d0 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:32.160488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:32.161154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 907/1807] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:32.161391 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:32.161926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:32.162202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] PATH_INFO: `/v3/projects/27c298eafd114327ac77b32b2944349f` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:32.163413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3928f-b399-4bd9-8e46-5a5b9058b1b0 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:32.163841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3928f-b399-4bd9-8e46-5a5b9058b1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:32.164003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3928f-b399-4bd9-8e46-5a5b9058b1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:32.166541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c298eafd114327ac77b32b2944349f)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:32.168589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:32.206420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-aae3928f-b399-4bd9-8e46-5a5b9058b1b0 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:32.208084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-aae3928f-b399-4bd9-8e46-5a5b9058b1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:32.223791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 908/1808] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:32.226389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3928f-b399-4bd9-8e46-5a5b9058b1b0 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:32.239566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3928f-b399-4bd9-8e46-5a5b9058b1b0 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:32.248606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9494d-f196-4bea-8db5-fc405a834154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:32.250795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9494d-f196-4bea-8db5-fc405a834154 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:32.251510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9494d-f196-4bea-8db5-fc405a834154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:32.251934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9494d-f196-4bea-8db5-fc405a834154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:32.252955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9494d-f196-4bea-8db5-fc405a834154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:32.253406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9494d-f196-4bea-8db5-fc405a834154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:32.256411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9494d-f196-4bea-8db5-fc405a834154 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:32.280199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:32.299181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 909/1809] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:32.302689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9494d-f196-4bea-8db5-fc405a834154 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:32.308831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c298eafd114327ac77b32b2944349f', 'request_id': 'req-440206ce-ef19-4061-90eb-9068b76266fd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.338881 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c298eafd114327ac77b32b2944349f', 'request_id': 'req-440206ce-ef19-4061-90eb-9068b76266fd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.343315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9494d-f196-4bea-8db5-fc405a834154 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:32.356247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c298eafd114327ac77b32b2944349f', 'request_id': 'req-440206ce-ef19-4061-90eb-9068b76266fd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.403884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] The token cache is being invalidate because project 27c298eafd114327ac77b32b2944349f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:32.404342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.408838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-440206ce-ef19-4061-90eb-9068b76266fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.416181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 901/1810] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:31 2022] DELETE /identity/v3/projects/27c298eafd114327ac77b32b2944349f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:32.417707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d0688-cb46-484f-b8f2-5aed66e10965 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:32.418000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d0688-cb46-484f-b8f2-5aed66e10965 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:32.418281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d0688-cb46-484f-b8f2-5aed66e10965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:32.477349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c25d0688-cb46-484f-b8f2-5aed66e10965 None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:32.481036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c25d0688-cb46-484f-b8f2-5aed66e10965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:32.511860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:32.553294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998fbff-2735-47ad-92dc-9e5655013a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:32.553978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998fbff-2735-47ad-92dc-9e5655013a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:32.554262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998fbff-2735-47ad-92dc-9e5655013a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:32.554538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998fbff-2735-47ad-92dc-9e5655013a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:32.555246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998fbff-2735-47ad-92dc-9e5655013a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:32.557180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998fbff-2735-47ad-92dc-9e5655013a52 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:32.626197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 910/1811] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:32 2022] POST /identity/v3/projects => generated 387 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:32.626197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998fbff-2735-47ad-92dc-9e5655013a52 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:32.639947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7998fbff-2735-47ad-92dc-9e5655013a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:32.685179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 902/1812] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:12:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:32.686058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d0688-cb46-484f-b8f2-5aed66e10965 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:32.692016 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c25d0688-cb46-484f-b8f2-5aed66e10965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:32.722884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d0688-cb46-484f-b8f2-5aed66e10965 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:32.784890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998fbff-2735-47ad-92dc-9e5655013a52 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:32.803732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:32.804662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:32.804944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:32.805370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] PATH_INFO: `/v3/users/0aeafff56f734d80b0845a6916e5ebee` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:32.806853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aeafff56f734d80b0845a6916e5ebee)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:32.808862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:32.857763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400bf3d-a597-449f-bf07-b0b180b64a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:32.858505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400bf3d-a597-449f-bf07-b0b180b64a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:32.858784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400bf3d-a597-449f-bf07-b0b180b64a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:32.859064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400bf3d-a597-449f-bf07-b0b180b64a76 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:32.860271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400bf3d-a597-449f-bf07-b0b180b64a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:32.864597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400bf3d-a597-449f-bf07-b0b180b64a76 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:32.919277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aeafff56f734d80b0845a6916e5ebee'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.919843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 903/1813] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:32 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:32.920444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400bf3d-a597-449f-bf07-b0b180b64a76 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:32.933344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aeafff56f734d80b0845a6916e5ebee'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.956281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400bf3d-a597-449f-bf07-b0b180b64a76 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:32.963243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79dbae-e19f-4bbc-92ba-8447337009f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:32.967610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79dbae-e19f-4bbc-92ba-8447337009f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:32.968138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79dbae-e19f-4bbc-92ba-8447337009f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:32.968655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79dbae-e19f-4bbc-92ba-8447337009f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:32.969860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79dbae-e19f-4bbc-92ba-8447337009f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:32.972430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79dbae-e19f-4bbc-92ba-8447337009f4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:32.978657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aeafff56f734d80b0845a6916e5ebee'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.979996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aeafff56f734d80b0845a6916e5ebee'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.981004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aeafff56f734d80b0845a6916e5ebee'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:32.991196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 904/1814] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:33.012658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79dbae-e19f-4bbc-92ba-8447337009f4 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:33.016775 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2e79dbae-e19f-4bbc-92ba-8447337009f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:33.033575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79dbae-e19f-4bbc-92ba-8447337009f4 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:33.033973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 911/1815] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:32 2022] DELETE /identity/v3/users/0aeafff56f734d80b0845a6916e5ebee => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:33.036916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:33.040234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:33.069702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:33.357833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65c1e-8c93-4576-b65a-e8d970acee41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:33.358751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65c1e-8c93-4576-b65a-e8d970acee41 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:33.359210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65c1e-8c93-4576-b65a-e8d970acee41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:33.359553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65c1e-8c93-4576-b65a-e8d970acee41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:33.360435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65c1e-8c93-4576-b65a-e8d970acee41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:33.366070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65c1e-8c93-4576-b65a-e8d970acee41 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:33.400772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 905/1816] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:33.402742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65c1e-8c93-4576-b65a-e8d970acee41 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:33.407992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-60d65c1e-8c93-4576-b65a-e8d970acee41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:33.420433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f145e57-99ba-4fb9-a1b7-98990fcca158 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:33.461335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:33.462835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:33.463266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:33.463707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] PATH_INFO: `/v3/projects/fddb58318c784dea94d8fa7b85edcab4` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:33.465832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fddb58318c784dea94d8fa7b85edcab4)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:33.470818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:33.472195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:33.597283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65c1e-8c93-4576-b65a-e8d970acee41 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:33.608949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fddb58318c784dea94d8fa7b85edcab4', 'request_id': 'req-789ac02b-b2eb-4371-905b-2e296f00061a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:33.621953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fddb58318c784dea94d8fa7b85edcab4', 'request_id': 'req-789ac02b-b2eb-4371-905b-2e296f00061a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:33.638251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fddb58318c784dea94d8fa7b85edcab4', 'request_id': 'req-789ac02b-b2eb-4371-905b-2e296f00061a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:33.677730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] The token cache is being invalidate because project fddb58318c784dea94d8fa7b85edcab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:33.678190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:33.680311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:33.683553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 912/1817] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:33 2022] DELETE /identity/v3/projects/fddb58318c784dea94d8fa7b85edcab4 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:33.685132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:33.689365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:33.739271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:33.740002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:33.740489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:33.740855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:33.743199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:33.759441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:33.762020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:33.799574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 906/1818] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:33.800879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:33.805696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:33.842270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ac02b-b2eb-4371-905b-2e296f00061a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:33.855498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b31d3c-0aaa-45a3-a7d6-2eba063bf7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:33.856994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b31d3c-0aaa-45a3-a7d6-2eba063bf7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:33.857491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b31d3c-0aaa-45a3-a7d6-2eba063bf7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:33.858462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b31d3c-0aaa-45a3-a7d6-2eba063bf7e4 admin admin] PATH_INFO: `/v3/projects/78c5150aa0774bc1a727414e6df399b3/users/dd3aff948a6b4818b68106c5bc5261e1/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:33.888275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b31d3c-0aaa-45a3-a7d6-2eba063bf7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c5150aa0774bc1a727414e6df399b3, user_id=dd3aff948a6b4818b68106c5bc5261e1, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:33.892843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b31d3c-0aaa-45a3-a7d6-2eba063bf7e4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:33.929957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 913/1819] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:33 2022] PUT /identity/v3/projects/78c5150aa0774bc1a727414e6df399b3/users/dd3aff948a6b4818b68106c5bc5261e1/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:33.935304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167b7e-af71-48a5-b1dc-2a7996e0978d service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:33.947561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80885211-27a1-48ce-88f4-2547590b9dea None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:33.949424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80885211-27a1-48ce-88f4-2547590b9dea None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:33.951333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80885211-27a1-48ce-88f4-2547590b9dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:34.009734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-80885211-27a1-48ce-88f4-2547590b9dea None None] MFA Rules not processed for user `dd3aff948a6b4818b68106c5bc5261e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:34.012465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-80885211-27a1-48ce-88f4-2547590b9dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:34.020657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:34.108262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:34.148036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:34.149359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:34.149972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:34.150482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] PATH_INFO: `/v3/users/1be272bba97641dd89ac31546fb0fdac` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:34.151982 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be272bba97641dd89ac31546fb0fdac)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:34.154306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:34.170448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 914/1820] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:34.175382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80885211-27a1-48ce-88f4-2547590b9dea None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:34.190190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80885211-27a1-48ce-88f4-2547590b9dea None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:34.196918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ba9ed-d451-428e-a319-574821375e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:34.197818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ba9ed-d451-428e-a319-574821375e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:34.199193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ba9ed-d451-428e-a319-574821375e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:34.199193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ba9ed-d451-428e-a319-574821375e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:34.199364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ba9ed-d451-428e-a319-574821375e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:34.202266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ba9ed-d451-428e-a319-574821375e17 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:34.279021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 915/1821] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:34 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:12:34.282850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ba9ed-d451-428e-a319-574821375e17 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:34.292199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be272bba97641dd89ac31546fb0fdac'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:34.311740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be272bba97641dd89ac31546fb0fdac'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:34.312782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be272bba97641dd89ac31546fb0fdac'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:34.349334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be272bba97641dd89ac31546fb0fdac'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:34.351142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be272bba97641dd89ac31546fb0fdac'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:34.397837 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 907/1822] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:33 2022] DELETE /identity/v3/users/1be272bba97641dd89ac31546fb0fdac => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:34.514309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ba9ed-d451-428e-a319-574821375e17 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:34.657243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb0bd2-e065-4942-826f-451caa470865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:34.658110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb0bd2-e065-4942-826f-451caa470865 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:34.658543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb0bd2-e065-4942-826f-451caa470865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:34.658901 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb0bd2-e065-4942-826f-451caa470865 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:34.659813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb0bd2-e065-4942-826f-451caa470865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:34.669479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb0bd2-e065-4942-826f-451caa470865 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:34.701733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 916/1823] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:34 2022] POST /identity/v3/users => generated 300 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:34.703352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:34.705367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:34.732034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ca430-228f-4552-86db-e44155f9a0aa admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:34.744059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad45345-58b8-48d1-a371-fbbb0d71cd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:34.746735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad45345-58b8-48d1-a371-fbbb0d71cd73 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:34.748283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad45345-58b8-48d1-a371-fbbb0d71cd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:34.748739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad45345-58b8-48d1-a371-fbbb0d71cd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:34.750757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad45345-58b8-48d1-a371-fbbb0d71cd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:34.756834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad45345-58b8-48d1-a371-fbbb0d71cd73 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:34.791940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb0bd2-e065-4942-826f-451caa470865 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:34.793920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4dcb0bd2-e065-4942-826f-451caa470865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:34.827947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb0bd2-e065-4942-826f-451caa470865 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:34.836765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 908/1824] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:34.844985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad45345-58b8-48d1-a371-fbbb0d71cd73 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:34.868204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:34.871555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:34.871854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:34.872173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] PATH_INFO: `/v3/projects/5e779ab4512c49c29231a72043800ec0` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:34.880633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e779ab4512c49c29231a72043800ec0)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:34.883281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:34.889780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad45345-58b8-48d1-a371-fbbb0d71cd73 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:34.902065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cdb8b-00a4-4daf-98f4-6c27a8972345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:34.904156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cdb8b-00a4-4daf-98f4-6c27a8972345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:34.906183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cdb8b-00a4-4daf-98f4-6c27a8972345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:34.906705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cdb8b-00a4-4daf-98f4-6c27a8972345 admin admin] PATH_INFO: `/v3/projects/42f8e217ed004c1bb67e87fe94cd1a15/users/a0db6f125b0444e0a93a0d3de32c6c86/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:34.932052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:34.936031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cdb8b-00a4-4daf-98f4-6c27a8972345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f8e217ed004c1bb67e87fe94cd1a15, user_id=a0db6f125b0444e0a93a0d3de32c6c86, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:34.940866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cdb8b-00a4-4daf-98f4-6c27a8972345 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:34.999348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 909/1825] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:34 2022] PUT /identity/v3/projects/42f8e217ed004c1bb67e87fe94cd1a15/users/a0db6f125b0444e0a93a0d3de32c6c86/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:35.003105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e779ab4512c49c29231a72043800ec0', 'request_id': 'req-a88c71cb-02fd-4c89-b590-0f1b0868aacb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:35.003252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cdb8b-00a4-4daf-98f4-6c27a8972345 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:35.023889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e779ab4512c49c29231a72043800ec0', 'request_id': 'req-a88c71cb-02fd-4c89-b590-0f1b0868aacb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:35.041925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e779ab4512c49c29231a72043800ec0', 'request_id': 'req-a88c71cb-02fd-4c89-b590-0f1b0868aacb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:35.078927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] The token cache is being invalidate because project 5e779ab4512c49c29231a72043800ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:35.079641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:35.080907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a88c71cb-02fd-4c89-b590-0f1b0868aacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:35.084682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 917/1826] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:34 2022] DELETE /identity/v3/projects/5e779ab4512c49c29231a72043800ec0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:35.090155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00181d-fed1-483d-91a7-a2e2b7776b71 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:35.090702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00181d-fed1-483d-91a7-a2e2b7776b71 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:35.091126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00181d-fed1-483d-91a7-a2e2b7776b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:35.129693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ef00181d-fed1-483d-91a7-a2e2b7776b71 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:35.138180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ef00181d-fed1-483d-91a7-a2e2b7776b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:35.185176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cdb8b-00a4-4daf-98f4-6c27a8972345 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:35.290453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:35.331847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87d875-c35c-45c1-8a84-44af29193584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:35.334464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87d875-c35c-45c1-8a84-44af29193584 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:35.338736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87d875-c35c-45c1-8a84-44af29193584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:35.340074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87d875-c35c-45c1-8a84-44af29193584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:35.342363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87d875-c35c-45c1-8a84-44af29193584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:35.348909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87d875-c35c-45c1-8a84-44af29193584 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:35.364079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 918/1827] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:35.377214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf846-5eba-499c-8425-02e8ac5849a9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:35.377529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf846-5eba-499c-8425-02e8ac5849a9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:35.377822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf846-5eba-499c-8425-02e8ac5849a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:35.389037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 910/1828] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:12:35.390906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87d875-c35c-45c1-8a84-44af29193584 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:35.395014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9c87d875-c35c-45c1-8a84-44af29193584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:35.453329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87d875-c35c-45c1-8a84-44af29193584 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:35.456684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e1ddf846-5eba-499c-8425-02e8ac5849a9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:35.460924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e1ddf846-5eba-499c-8425-02e8ac5849a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:35.469586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a987906-1c42-4ef2-a65f-adbb70e074e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:35.470961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a987906-1c42-4ef2-a65f-adbb70e074e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:35.473139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a987906-1c42-4ef2-a65f-adbb70e074e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:35.476092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a987906-1c42-4ef2-a65f-adbb70e074e4 admin admin] PATH_INFO: `/v3/projects/42f8e217ed004c1bb67e87fe94cd1a15/users/a0db6f125b0444e0a93a0d3de32c6c86/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:35.483466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a987906-1c42-4ef2-a65f-adbb70e074e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f8e217ed004c1bb67e87fe94cd1a15, user_id=a0db6f125b0444e0a93a0d3de32c6c86, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:35.491192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a987906-1c42-4ef2-a65f-adbb70e074e4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:35.498012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 919/1829] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:35.518370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf846-5eba-499c-8425-02e8ac5849a9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:35.519942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 911/1830] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:35 2022] PUT /identity/v3/projects/42f8e217ed004c1bb67e87fe94cd1a15/users/a0db6f125b0444e0a93a0d3de32c6c86/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:35.532104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee428c-d262-4327-ad18-82b38a7a651e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:35.532915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee428c-d262-4327-ad18-82b38a7a651e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:35.533561 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee428c-d262-4327-ad18-82b38a7a651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:35.567932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf846-5eba-499c-8425-02e8ac5849a9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:35.644901 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b4ee428c-d262-4327-ad18-82b38a7a651e None None] MFA Rules not processed for user `a0db6f125b0444e0a93a0d3de32c6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:35.647775 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b4ee428c-d262-4327-ad18-82b38a7a651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:35.751155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b0bd2-0076-4d55-b38c-725b8a2fee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:35.753200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b0bd2-0076-4d55-b38c-725b8a2fee30 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:35.754133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b0bd2-0076-4d55-b38c-725b8a2fee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:35.754633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b0bd2-0076-4d55-b38c-725b8a2fee30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:35.759141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b0bd2-0076-4d55-b38c-725b8a2fee30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:35.760295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b0bd2-0076-4d55-b38c-725b8a2fee30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:35.764231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b0bd2-0076-4d55-b38c-725b8a2fee30 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:35.789972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 920/1831] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:35.795044 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b0bd2-0076-4d55-b38c-725b8a2fee30 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:35.812135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b0bd2-0076-4d55-b38c-725b8a2fee30 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:35.823294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebcaf1-5292-423c-b72d-d576481b27f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:35.824523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebcaf1-5292-423c-b72d-d576481b27f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:35.825069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebcaf1-5292-423c-b72d-d576481b27f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:35.825566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebcaf1-5292-423c-b72d-d576481b27f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:35.826776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebcaf1-5292-423c-b72d-d576481b27f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:35.829859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebcaf1-5292-423c-b72d-d576481b27f7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:35.867999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 912/1832] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:35.893153 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee428c-d262-4327-ad18-82b38a7a651e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:35.902377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b4ee428c-d262-4327-ad18-82b38a7a651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:35.903530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 921/1833] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:35 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:35.904710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebcaf1-5292-423c-b72d-d576481b27f7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:35.910835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-82ebcaf1-5292-423c-b72d-d576481b27f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:35.954903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:36.094837 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee428c-d262-4327-ad18-82b38a7a651e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:36.145215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebcaf1-5292-423c-b72d-d576481b27f7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:36.163681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:36.169418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:36.169626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:36.169912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] PATH_INFO: `/v3/projects/c864a75eecdd4d4c8730155b5c3a36f5` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:36.173996 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c864a75eecdd4d4c8730155b5c3a36f5)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:36.181586 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:36.280682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69570ace-a233-4e1a-8663-211a8b7ed02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:36.281196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69570ace-a233-4e1a-8663-211a8b7ed02e service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:36.281438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69570ace-a233-4e1a-8663-211a8b7ed02e service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:36.281733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69570ace-a233-4e1a-8663-211a8b7ed02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:36.344463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c864a75eecdd4d4c8730155b5c3a36f5', 'request_id': 'req-cd55df4d-6ce6-4d93-89c4-936ce293f471'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:36.346438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:36.384557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c864a75eecdd4d4c8730155b5c3a36f5', 'request_id': 'req-cd55df4d-6ce6-4d93-89c4-936ce293f471'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:36.401200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c864a75eecdd4d4c8730155b5c3a36f5', 'request_id': 'req-cd55df4d-6ce6-4d93-89c4-936ce293f471'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:36.457893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69570ace-a233-4e1a-8663-211a8b7ed02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:36.459780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69570ace-a233-4e1a-8663-211a8b7ed02e service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:36.462510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] The token cache is being invalidate because project c864a75eecdd4d4c8730155b5c3a36f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:36.463481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:36.466205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:36.482596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 922/1834] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:35 2022] DELETE /identity/v3/projects/c864a75eecdd4d4c8730155b5c3a36f5 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:36.482596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:36.485701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:36.492523 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 913/1835] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:36.494092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4884c-c372-4173-be21-51134fd230e9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:36.495075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4884c-c372-4173-be21-51134fd230e9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:36.495075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4884c-c372-4173-be21-51134fd230e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:36.601367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-90d4884c-c372-4173-be21-51134fd230e9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:36.606491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-90d4884c-c372-4173-be21-51134fd230e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:36.688967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55df4d-6ce6-4d93-89c4-936ce293f471 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:36.709868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee8c7e-33ba-431a-8320-674bc08be23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:36.712351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee8c7e-33ba-431a-8320-674bc08be23a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:36.712846 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee8c7e-33ba-431a-8320-674bc08be23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:36.714304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee8c7e-33ba-431a-8320-674bc08be23a admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:36.717396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee8c7e-33ba-431a-8320-674bc08be23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:36.721767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee8c7e-33ba-431a-8320-674bc08be23a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:36.819670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 923/1836] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:36 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:36.824005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee8c7e-33ba-431a-8320-674bc08be23a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:36.829649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-96ee8c7e-33ba-431a-8320-674bc08be23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:36.860696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 914/1837] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:36.862655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee8c7e-33ba-431a-8320-674bc08be23a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:36.864060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4884c-c372-4173-be21-51134fd230e9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:36.876743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:36.879788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:36.881354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:36.882078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] PATH_INFO: `/v3/users/dd3aff948a6b4818b68106c5bc5261e1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:36.885690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3aff948a6b4818b68106c5bc5261e1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:36.892594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:36.893491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4884c-c372-4173-be21-51134fd230e9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:36.904925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146fc09-b29f-4671-a45a-fa22a25124c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:36.907150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146fc09-b29f-4671-a45a-fa22a25124c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:36.907381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146fc09-b29f-4671-a45a-fa22a25124c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:36.910876 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146fc09-b29f-4671-a45a-fa22a25124c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:36.911335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146fc09-b29f-4671-a45a-fa22a25124c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:36.918069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146fc09-b29f-4671-a45a-fa22a25124c9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:36.952191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 915/1838] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:36.955026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ca5b-b568-47ec-8aaf-41a79390e323 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:36.956183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ca5b-b568-47ec-8aaf-41a79390e323 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:36.957519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ca5b-b568-47ec-8aaf-41a79390e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:36.987980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:37.060672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9709ca5b-b568-47ec-8aaf-41a79390e323 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:37.063108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3aff948a6b4818b68106c5bc5261e1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:37.070880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9709ca5b-b568-47ec-8aaf-41a79390e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:37.099100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3aff948a6b4818b68106c5bc5261e1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:37.110553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 916/1839] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:37.112454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709ca5b-b568-47ec-8aaf-41a79390e323 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.156539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3aff948a6b4818b68106c5bc5261e1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:37.157906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709ca5b-b568-47ec-8aaf-41a79390e323 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:37.159104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3aff948a6b4818b68106c5bc5261e1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:37.160303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3aff948a6b4818b68106c5bc5261e1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:37.172133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea6a05-9b34-4f0c-a016-7bebf89ed005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:37.172829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6a05-9b34-4f0c-a016-7bebf89ed005 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.173114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6a05-9b34-4f0c-a016-7bebf89ed005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.173378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6a05-9b34-4f0c-a016-7bebf89ed005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.176793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea6a05-9b34-4f0c-a016-7bebf89ed005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:37.183515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea6a05-9b34-4f0c-a016-7bebf89ed005 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:37.189356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 924/1840] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:36 2022] DELETE /identity/v3/users/dd3aff948a6b4818b68106c5bc5261e1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:37.193926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.202411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:37.212580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 917/1841] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:37.214681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebaeb4-ad28-4b19-8d83-a29f3ca44e27 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.215210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebaeb4-ad28-4b19-8d83-a29f3ca44e27 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.216187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebaeb4-ad28-4b19-8d83-a29f3ca44e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.242395 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-04ebaeb4-ad28-4b19-8d83-a29f3ca44e27 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:37.244112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-04ebaeb4-ad28-4b19-8d83-a29f3ca44e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:37.360947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068edb-e40d-46ff-9ce0-8bf355c625be admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:37.376025 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 918/1842] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:37.377806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebaeb4-ad28-4b19-8d83-a29f3ca44e27 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.379467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-04ebaeb4-ad28-4b19-8d83-a29f3ca44e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:37.380459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:37.381731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.382025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.382285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.383587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:37.383935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:37.385785 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:37.399221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebaeb4-ad28-4b19-8d83-a29f3ca44e27 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:37.409194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733c941-19f8-42f7-950a-420bb7dd5605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:37.410103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733c941-19f8-42f7-950a-420bb7dd5605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.410389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733c941-19f8-42f7-950a-420bb7dd5605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.410668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733c941-19f8-42f7-950a-420bb7dd5605 admin admin] PATH_INFO: `/v3/projects/0c33fb0a44b64007b3a7d25798c2f8d0/users/6f24b8de04f04fdbb2d2d5f9e760edce/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.411530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 925/1843] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:37.415699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.417825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:37.433686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733c941-19f8-42f7-950a-420bb7dd5605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c33fb0a44b64007b3a7d25798c2f8d0, user_id=6f24b8de04f04fdbb2d2d5f9e760edce, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:37.436731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733c941-19f8-42f7-950a-420bb7dd5605 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:37.473709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 919/1844] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:37 2022] PUT /identity/v3/projects/0c33fb0a44b64007b3a7d25798c2f8d0/users/6f24b8de04f04fdbb2d2d5f9e760edce/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:37.485045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733c941-19f8-42f7-950a-420bb7dd5605 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.496280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:37.546073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997937b-1408-4f05-860e-b278f2a3c29d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:37.614504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d34ed6-0ef8-41be-93a8-3dc9ffa81b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:37.617201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d34ed6-0ef8-41be-93a8-3dc9ffa81b68 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.617549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d34ed6-0ef8-41be-93a8-3dc9ffa81b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.617940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d34ed6-0ef8-41be-93a8-3dc9ffa81b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.619677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733c941-19f8-42f7-950a-420bb7dd5605 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:37.625609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:37.625950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1a566-7942-4338-a274-44beffdb7269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:37.627605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1a566-7942-4338-a274-44beffdb7269 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.628080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1a566-7942-4338-a274-44beffdb7269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.628611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1a566-7942-4338-a274-44beffdb7269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.628737 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d34ed6-0ef8-41be-93a8-3dc9ffa81b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:37.631232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d34ed6-0ef8-41be-93a8-3dc9ffa81b68 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:37.631879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1a566-7942-4338-a274-44beffdb7269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:37.634372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1a566-7942-4338-a274-44beffdb7269 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:37.651140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 926/1845] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:37.652201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc2a5-13c9-40ca-a5c4-75cd72ef8041 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.652494 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc2a5-13c9-40ca-a5c4-75cd72ef8041 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.652773 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc2a5-13c9-40ca-a5c4-75cd72ef8041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.682444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 920/1846] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:37 2022] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:37.685116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1a566-7942-4338-a274-44beffdb7269 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.687677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-827fc2a5-13c9-40ca-a5c4-75cd72ef8041 None None] MFA Rules not processed for user `6f24b8de04f04fdbb2d2d5f9e760edce`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:37.692543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-827fc2a5-13c9-40ca-a5c4-75cd72ef8041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:37.788459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 927/1847] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:37.790234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fc2a5-13c9-40ca-a5c4-75cd72ef8041 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.827868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1a566-7942-4338-a274-44beffdb7269 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:37.832971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c706935-a0e6-4aba-9d8f-0d62e1f88f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:37.834634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c706935-a0e6-4aba-9d8f-0d62e1f88f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.834974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c706935-a0e6-4aba-9d8f-0d62e1f88f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.835257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c706935-a0e6-4aba-9d8f-0d62e1f88f51 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.836157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c706935-a0e6-4aba-9d8f-0d62e1f88f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:37.838152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c706935-a0e6-4aba-9d8f-0d62e1f88f51 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:37.878728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 921/1848] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:37 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:37.879735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c706935-a0e6-4aba-9d8f-0d62e1f88f51 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.894431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c706935-a0e6-4aba-9d8f-0d62e1f88f51 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:37.902227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4a033-9edb-45f6-b7b9-c1963e0ebc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:37.902915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4a033-9edb-45f6-b7b9-c1963e0ebc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.903200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4a033-9edb-45f6-b7b9-c1963e0ebc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.903478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4a033-9edb-45f6-b7b9-c1963e0ebc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.904270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4a033-9edb-45f6-b7b9-c1963e0ebc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:37.906574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4a033-9edb-45f6-b7b9-c1963e0ebc31 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:37.922030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 922/1849] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:37.923293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fc2a5-13c9-40ca-a5c4-75cd72ef8041 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:37.935693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4a033-9edb-45f6-b7b9-c1963e0ebc31 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.936418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f256b-1455-4289-b676-86f6e3b61a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:37.938481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f256b-1455-4289-b676-86f6e3b61a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.938940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f256b-1455-4289-b676-86f6e3b61a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.939322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f256b-1455-4289-b676-86f6e3b61a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.942595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f256b-1455-4289-b676-86f6e3b61a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:37.944990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f256b-1455-4289-b676-86f6e3b61a17 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:37.950571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4a033-9edb-45f6-b7b9-c1963e0ebc31 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:37.962838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598456dd-3441-401a-8476-8ddf2f306d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:37.963737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598456dd-3441-401a-8476-8ddf2f306d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:37.964292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598456dd-3441-401a-8476-8ddf2f306d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:37.964576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598456dd-3441-401a-8476-8ddf2f306d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:37.965384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598456dd-3441-401a-8476-8ddf2f306d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:37.968131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598456dd-3441-401a-8476-8ddf2f306d15 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:37.987387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 923/1850] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:37.988388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598456dd-3441-401a-8476-8ddf2f306d15 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:37.992496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 928/1851] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:37 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:37.997150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f256b-1455-4289-b676-86f6e3b61a17 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:38.003184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598456dd-3441-401a-8476-8ddf2f306d15 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:38.086371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:38.096246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f256b-1455-4289-b676-86f6e3b61a17 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:38.108342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194fb89-2698-4944-9e1e-48a45525b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:38.108342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194fb89-2698-4944-9e1e-48a45525b6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.108342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194fb89-2698-4944-9e1e-48a45525b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.112331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194fb89-2698-4944-9e1e-48a45525b6ee admin admin] PATH_INFO: `/v3/projects/1a88d764ad5c435b8c0f9c6e9ff3ddf1/users/b5f2b09ee27943359a4fc5f87d5f797a/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.136804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810f961-904e-44ee-a97d-054e49df5a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:38.137737 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810f961-904e-44ee-a97d-054e49df5a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.137878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810f961-904e-44ee-a97d-054e49df5a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.138299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810f961-904e-44ee-a97d-054e49df5a21 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.139850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810f961-904e-44ee-a97d-054e49df5a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:38.142148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810f961-904e-44ee-a97d-054e49df5a21 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:38.142398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194fb89-2698-4944-9e1e-48a45525b6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a88d764ad5c435b8c0f9c6e9ff3ddf1, user_id=b5f2b09ee27943359a4fc5f87d5f797a, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:38.147184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194fb89-2698-4944-9e1e-48a45525b6ee admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:38.166625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:38.181267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 924/1852] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:37 2022] PUT /identity/v3/projects/1a88d764ad5c435b8c0f9c6e9ff3ddf1/users/b5f2b09ee27943359a4fc5f87d5f797a/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:38.181462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 929/1853] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:37 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:12:38.182822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194fb89-2698-4944-9e1e-48a45525b6ee admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:38.191521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a8c2-fd5c-43b9-b6d1-63657d327140 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.191817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a8c2-fd5c-43b9-b6d1-63657d327140 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.192239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a8c2-fd5c-43b9-b6d1-63657d327140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.258622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1799a8c2-fd5c-43b9-b6d1-63657d327140 None None] MFA Rules not processed for user `b5f2b09ee27943359a4fc5f87d5f797a`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:38.259866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1799a8c2-fd5c-43b9-b6d1-63657d327140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:38.301507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194fb89-2698-4944-9e1e-48a45525b6ee admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:38.310143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e11aa-47c0-4183-8777-8e14e27ee0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:38.312046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e11aa-47c0-4183-8777-8e14e27ee0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.312459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e11aa-47c0-4183-8777-8e14e27ee0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.312755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e11aa-47c0-4183-8777-8e14e27ee0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.313706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e11aa-47c0-4183-8777-8e14e27ee0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:38.315534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e11aa-47c0-4183-8777-8e14e27ee0ad admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:38.337548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 925/1854] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:12:38.338124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e11aa-47c0-4183-8777-8e14e27ee0ad admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:38.360856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e11aa-47c0-4183-8777-8e14e27ee0ad admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:38.372673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d5a4-501d-4622-b823-d40cadae914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:38.373639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d5a4-501d-4622-b823-d40cadae914d admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.373900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d5a4-501d-4622-b823-d40cadae914d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.374183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d5a4-501d-4622-b823-d40cadae914d admin admin] PATH_INFO: `/v3/projects/1e84ba8ea25f4b0a94eeb66450304470/users/582e09b213004b4c8fb09cbf4ea153b5/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.389293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 930/1855] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:38.391599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799a8c2-fd5c-43b9-b6d1-63657d327140 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:38.397949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03d5a4-501d-4622-b823-d40cadae914d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e84ba8ea25f4b0a94eeb66450304470, user_id=582e09b213004b4c8fb09cbf4ea153b5, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:38.400893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03d5a4-501d-4622-b823-d40cadae914d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:38.420747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799a8c2-fd5c-43b9-b6d1-63657d327140 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:38.427552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 926/1856] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:38 2022] PUT /identity/v3/projects/1e84ba8ea25f4b0a94eeb66450304470/users/582e09b213004b4c8fb09cbf4ea153b5/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:38.428541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d5a4-501d-4622-b823-d40cadae914d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:38.515727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048cee0-92ae-4d62-970a-ee4a153cf280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:38.516490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048cee0-92ae-4d62-970a-ee4a153cf280 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.516966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048cee0-92ae-4d62-970a-ee4a153cf280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.517406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048cee0-92ae-4d62-970a-ee4a153cf280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.518915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048cee0-92ae-4d62-970a-ee4a153cf280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:38.522845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048cee0-92ae-4d62-970a-ee4a153cf280 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:38.526343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d5a4-501d-4622-b823-d40cadae914d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:38.532927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae2e1c-3d6d-42c1-9485-f80a4c6a38ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:38.534194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae2e1c-3d6d-42c1-9485-f80a4c6a38ef admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.534502 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae2e1c-3d6d-42c1-9485-f80a4c6a38ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.534859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae2e1c-3d6d-42c1-9485-f80a4c6a38ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.535608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae2e1c-3d6d-42c1-9485-f80a4c6a38ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:38.538884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae2e1c-3d6d-42c1-9485-f80a4c6a38ef admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:38.550957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 927/1857] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:38.551937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae2e1c-3d6d-42c1-9485-f80a4c6a38ef admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:38.561053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-86ae2e1c-3d6d-42c1-9485-f80a4c6a38ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:38.577553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae2e1c-3d6d-42c1-9485-f80a4c6a38ef admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:38.582170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 931/1858] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:38 2022] POST /identity/v3/projects => generated 391 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:38.583148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048cee0-92ae-4d62-970a-ee4a153cf280 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:38.652866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:38.677195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:38.678130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.678423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.678709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] PATH_INFO: `/v3/projects/78c5150aa0774bc1a727414e6df399b3` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.681852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c5150aa0774bc1a727414e6df399b3)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:38.683707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:38.727176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048cee0-92ae-4d62-970a-ee4a153cf280 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:38.734210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57108e-df9b-46fe-8292-2bc052627281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:38.735184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57108e-df9b-46fe-8292-2bc052627281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.735395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57108e-df9b-46fe-8292-2bc052627281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.736218 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57108e-df9b-46fe-8292-2bc052627281 admin admin] PATH_INFO: `/v3/projects/1e84ba8ea25f4b0a94eeb66450304470/users/582e09b213004b4c8fb09cbf4ea153b5/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.738463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57108e-df9b-46fe-8292-2bc052627281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e84ba8ea25f4b0a94eeb66450304470, user_id=582e09b213004b4c8fb09cbf4ea153b5, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:38.742098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57108e-df9b-46fe-8292-2bc052627281 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:38.762457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 932/1859] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:38 2022] PUT /identity/v3/projects/1e84ba8ea25f4b0a94eeb66450304470/users/582e09b213004b4c8fb09cbf4ea153b5/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:38.775823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57108e-df9b-46fe-8292-2bc052627281 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:38.800596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:38.816003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c5150aa0774bc1a727414e6df399b3', 'request_id': 'req-5f147bb5-3b25-448d-ae54-8d60fc1526ab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:38.826452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c5150aa0774bc1a727414e6df399b3', 'request_id': 'req-5f147bb5-3b25-448d-ae54-8d60fc1526ab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:38.836908 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c5150aa0774bc1a727414e6df399b3', 'request_id': 'req-5f147bb5-3b25-448d-ae54-8d60fc1526ab'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:38.861551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] The token cache is being invalidate because project 78c5150aa0774bc1a727414e6df399b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:38.861996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:38.863186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5f147bb5-3b25-448d-ae54-8d60fc1526ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:38.866294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 928/1860] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:38 2022] DELETE /identity/v3/projects/78c5150aa0774bc1a727414e6df399b3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:38.868001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6897-3040-40a4-9189-0f6e4a4f7199 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:38.868394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6897-3040-40a4-9189-0f6e4a4f7199 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:38.868826 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6897-3040-40a4-9189-0f6e4a4f7199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:38.905819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-549a6897-3040-40a4-9189-0f6e4a4f7199 None None] MFA Rules not processed for user `582e09b213004b4c8fb09cbf4ea153b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:38.907566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-549a6897-3040-40a4-9189-0f6e4a4f7199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:38.916133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57108e-df9b-46fe-8292-2bc052627281 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:39.005349 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d201d-ec1a-45e5-a7bd-d2eb06a19be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:39.006770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d201d-ec1a-45e5-a7bd-d2eb06a19be7 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:39.007054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d201d-ec1a-45e5-a7bd-d2eb06a19be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:39.007327 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d201d-ec1a-45e5-a7bd-d2eb06a19be7 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:39.008759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d201d-ec1a-45e5-a7bd-d2eb06a19be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:39.011345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d201d-ec1a-45e5-a7bd-d2eb06a19be7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:39.019186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 929/1861] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:39.020229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a6897-3040-40a4-9189-0f6e4a4f7199 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:39.021967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-549a6897-3040-40a4-9189-0f6e4a4f7199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:39.039780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a6897-3040-40a4-9189-0f6e4a4f7199 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:39.045340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:39.046642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:39.047035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:39.047486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] PATH_INFO: `/v3/users/a0db6f125b0444e0a93a0d3de32c6c86` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:39.049624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0db6f125b0444e0a93a0d3de32c6c86)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:39.051986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:39.060486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 933/1862] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:38 2022] POST /identity/v3/users => generated 302 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:39.060486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d201d-ec1a-45e5-a7bd-d2eb06a19be7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:39.060486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cf4d201d-ec1a-45e5-a7bd-d2eb06a19be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:39.167781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0db6f125b0444e0a93a0d3de32c6c86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:39.190630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0db6f125b0444e0a93a0d3de32c6c86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:39.192456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0db6f125b0444e0a93a0d3de32c6c86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:39.201156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:39.220928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0db6f125b0444e0a93a0d3de32c6c86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:39.222736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0db6f125b0444e0a93a0d3de32c6c86'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:39.259947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 930/1863] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:39 2022] DELETE /identity/v3/users/a0db6f125b0444e0a93a0d3de32c6c86 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:39.263121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:39.263603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d201d-ec1a-45e5-a7bd-d2eb06a19be7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:39.278275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:39.392404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf5f61-e3d7-4600-a0a3-5cb264944023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:39.394398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf5f61-e3d7-4600-a0a3-5cb264944023 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:39.394695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf5f61-e3d7-4600-a0a3-5cb264944023 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:39.394987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf5f61-e3d7-4600-a0a3-5cb264944023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:39.397985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d6cf5f61-e3d7-4600-a0a3-5cb264944023 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:39.418345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:39.422019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440e84-fad3-41da-b57d-8da85c1398ac admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:39.428201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58e99f-e4d3-4026-b68f-d1e6a50ffceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:39.429210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58e99f-e4d3-4026-b68f-d1e6a50ffceb admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:39.429564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58e99f-e4d3-4026-b68f-d1e6a50ffceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:39.429918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58e99f-e4d3-4026-b68f-d1e6a50ffceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:39.430742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58e99f-e4d3-4026-b68f-d1e6a50ffceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:39.437268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58e99f-e4d3-4026-b68f-d1e6a50ffceb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:39.464216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 931/1864] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:39.466710 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58e99f-e4d3-4026-b68f-d1e6a50ffceb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:39.482595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58e99f-e4d3-4026-b68f-d1e6a50ffceb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:39.491132 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6ecd5-79b6-4e95-a82b-9b8e28403e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:39.492090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6ecd5-79b6-4e95-a82b-9b8e28403e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:39.492379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6ecd5-79b6-4e95-a82b-9b8e28403e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:39.492661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6ecd5-79b6-4e95-a82b-9b8e28403e86 admin admin] PATH_INFO: `/v3/projects/3e102f1db7e640129b81a59cd20ebc46/users/7b657636e4bb42239114f9063dbf291d/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:39.511745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6ecd5-79b6-4e95-a82b-9b8e28403e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e102f1db7e640129b81a59cd20ebc46, user_id=7b657636e4bb42239114f9063dbf291d, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:39.514732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6ecd5-79b6-4e95-a82b-9b8e28403e86 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:39.516692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf5f61-e3d7-4600-a0a3-5cb264944023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:39.518234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf5f61-e3d7-4600-a0a3-5cb264944023 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:39.532747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 934/1865] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:39.538094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 932/1866] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:39 2022] PUT /identity/v3/projects/3e102f1db7e640129b81a59cd20ebc46/users/7b657636e4bb42239114f9063dbf291d/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:39.542540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf5f61-e3d7-4600-a0a3-5cb264944023 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:39.563844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf5f61-e3d7-4600-a0a3-5cb264944023 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:39.665816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438a0ff-598f-4ee3-8ad6-74f1f15d6a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:39.666795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a0ff-598f-4ee3-8ad6-74f1f15d6a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:39.667285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a0ff-598f-4ee3-8ad6-74f1f15d6a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:39.667798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a0ff-598f-4ee3-8ad6-74f1f15d6a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:39.668692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438a0ff-598f-4ee3-8ad6-74f1f15d6a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:39.670759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438a0ff-598f-4ee3-8ad6-74f1f15d6a04 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:39.688558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 935/1867] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:39.690900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6ecd5-79b6-4e95-a82b-9b8e28403e86 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:39.702500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6ecd5-79b6-4e95-a82b-9b8e28403e86 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:39.710358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c16f61-5541-4c4a-ae74-26075eaea39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:39.711224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c16f61-5541-4c4a-ae74-26075eaea39c admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:39.711655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c16f61-5541-4c4a-ae74-26075eaea39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:39.712119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c16f61-5541-4c4a-ae74-26075eaea39c admin admin] PATH_INFO: `/v3/projects/3e102f1db7e640129b81a59cd20ebc46/users/7b657636e4bb42239114f9063dbf291d/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:39.714421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c16f61-5541-4c4a-ae74-26075eaea39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e102f1db7e640129b81a59cd20ebc46, user_id=7b657636e4bb42239114f9063dbf291d, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:39.717756 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c16f61-5541-4c4a-ae74-26075eaea39c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:39.731636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 933/1868] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:39 2022] PUT /identity/v3/projects/3e102f1db7e640129b81a59cd20ebc46/users/7b657636e4bb42239114f9063dbf291d/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:39.743101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5917bd-022a-462b-98f3-0278055ff78a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:39.743101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5917bd-022a-462b-98f3-0278055ff78a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:39.743521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5917bd-022a-462b-98f3-0278055ff78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:39.773222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9b5917bd-022a-462b-98f3-0278055ff78a None None] MFA Rules not processed for user `7b657636e4bb42239114f9063dbf291d`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:39.774516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9b5917bd-022a-462b-98f3-0278055ff78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:39.804384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c16f61-5541-4c4a-ae74-26075eaea39c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:39.806119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-94c16f61-5541-4c4a-ae74-26075eaea39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:39.873727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 936/1869] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:39.886979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5917bd-022a-462b-98f3-0278055ff78a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:39.888509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9b5917bd-022a-462b-98f3-0278055ff78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:39.898373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c16f61-5541-4c4a-ae74-26075eaea39c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:39.904034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:39.905692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:39.906076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:39.906724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] PATH_INFO: `/v3/projects/42f8e217ed004c1bb67e87fe94cd1a15` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:39.909176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f8e217ed004c1bb67e87fe94cd1a15)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:39.911764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:39.930124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:39.956133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5917bd-022a-462b-98f3-0278055ff78a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:39.961258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:39.975080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f8e217ed004c1bb67e87fe94cd1a15', 'request_id': 'req-6d83800b-ce3d-4a0c-872f-526c70415994'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:39.982547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f8e217ed004c1bb67e87fe94cd1a15', 'request_id': 'req-6d83800b-ce3d-4a0c-872f-526c70415994'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:39.990281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f8e217ed004c1bb67e87fe94cd1a15', 'request_id': 'req-6d83800b-ce3d-4a0c-872f-526c70415994'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:40.010449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] The token cache is being invalidate because project 42f8e217ed004c1bb67e87fe94cd1a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:40.010890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:40.011948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d83800b-ce3d-4a0c-872f-526c70415994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:40.013837 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 934/1870] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:39 2022] DELETE /identity/v3/projects/42f8e217ed004c1bb67e87fe94cd1a15 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:40.018538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad321-b5c6-4ee3-a812-6a38cefb253f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.018921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad321-b5c6-4ee3-a812-6a38cefb253f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.019209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad321-b5c6-4ee3-a812-6a38cefb253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.032604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1859-4cf0-48fe-943d-dfa52f6484a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:40.033441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1859-4cf0-48fe-943d-dfa52f6484a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.033822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1859-4cf0-48fe-943d-dfa52f6484a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.034196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1859-4cf0-48fe-943d-dfa52f6484a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.036346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-332c1859-4cf0-48fe-943d-dfa52f6484a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:40.043858 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9edad321-b5c6-4ee3-a812-6a38cefb253f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:40.045414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9edad321-b5c6-4ee3-a812-6a38cefb253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:40.136210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 935/1871] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:40.144486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467aedf-e91d-4ef1-8c0e-486d3648ea1f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.144843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467aedf-e91d-4ef1-8c0e-486d3648ea1f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.145125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467aedf-e91d-4ef1-8c0e-486d3648ea1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.148933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c1859-4cf0-48fe-943d-dfa52f6484a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:40.150598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c1859-4cf0-48fe-943d-dfa52f6484a0 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:40.170921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 937/1872] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:40.178257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1467aedf-e91d-4ef1-8c0e-486d3648ea1f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:40.179748 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1467aedf-e91d-4ef1-8c0e-486d3648ea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:40.195040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1859-4cf0-48fe-943d-dfa52f6484a0 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:40.196061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 936/1873] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:40.206998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1859-4cf0-48fe-943d-dfa52f6484a0 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:40.212585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:40.213257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.213565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.213842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.214572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:40.214900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:40.216582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:40.234021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467aedf-e91d-4ef1-8c0e-486d3648ea1f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:40.240700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 938/1874] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:40.245183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467aedf-e91d-4ef1-8c0e-486d3648ea1f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:40.254019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722815db-988b-4350-b9ad-8dc69b55c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:40.254694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722815db-988b-4350-b9ad-8dc69b55c332 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.257170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722815db-988b-4350-b9ad-8dc69b55c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.257479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722815db-988b-4350-b9ad-8dc69b55c332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.260410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722815db-988b-4350-b9ad-8dc69b55c332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:40.262437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722815db-988b-4350-b9ad-8dc69b55c332 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:40.270732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:40.274113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:40.288884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09433d61-adb1-4d4b-907b-dc9e287a7c38 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:40.293227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffd93f-84b3-4be3-98c4-02033c10624f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:40.293902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd93f-84b3-4be3-98c4-02033c10624f service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.294193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd93f-84b3-4be3-98c4-02033c10624f service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.294469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd93f-84b3-4be3-98c4-02033c10624f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.296422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-62ffd93f-84b3-4be3-98c4-02033c10624f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:40.301342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 937/1875] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:40 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:40.304032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722815db-988b-4350-b9ad-8dc69b55c332 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:40.306618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-722815db-988b-4350-b9ad-8dc69b55c332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:40.429100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722815db-988b-4350-b9ad-8dc69b55c332 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:40.435391 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:40.436315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.436697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.437046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] PATH_INFO: `/v3/users/6f24b8de04f04fdbb2d2d5f9e760edce` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.438656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f24b8de04f04fdbb2d2d5f9e760edce)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:40.441277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:40.446817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffd93f-84b3-4be3-98c4-02033c10624f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:40.448689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffd93f-84b3-4be3-98c4-02033c10624f service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:40.464269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 939/1876] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:40.479677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffd93f-84b3-4be3-98c4-02033c10624f service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:40.511315 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffd93f-84b3-4be3-98c4-02033c10624f service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:40.525236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe6775-0ccb-404c-b61e-c33860b27c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:40.525926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6775-0ccb-404c-b61e-c33860b27c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.526212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6775-0ccb-404c-b61e-c33860b27c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.526497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6775-0ccb-404c-b61e-c33860b27c78 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.526836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:40.527193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe6775-0ccb-404c-b61e-c33860b27c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:40.531324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe6775-0ccb-404c-b61e-c33860b27c78 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:40.546040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f24b8de04f04fdbb2d2d5f9e760edce'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:40.563632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f24b8de04f04fdbb2d2d5f9e760edce'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:40.564721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f24b8de04f04fdbb2d2d5f9e760edce'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:40.605275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 940/1877] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:40 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:40.605873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe6775-0ccb-404c-b61e-c33860b27c78 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:40.608768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f24b8de04f04fdbb2d2d5f9e760edce'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:40.609892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5dadfec8-1c46-48b1-8af1-6c08b59d3cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f24b8de04f04fdbb2d2d5f9e760edce'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:40.617395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d6fe6775-0ccb-404c-b61e-c33860b27c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:40.640238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe6775-0ccb-404c-b61e-c33860b27c78 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:40.648487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104cb76-1343-4e53-96fb-b11cb11c6560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:40.649314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104cb76-1343-4e53-96fb-b11cb11c6560 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.649770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104cb76-1343-4e53-96fb-b11cb11c6560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.649914 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104cb76-1343-4e53-96fb-b11cb11c6560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.650675 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104cb76-1343-4e53-96fb-b11cb11c6560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:40.652706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104cb76-1343-4e53-96fb-b11cb11c6560 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:40.654374 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:40.660788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 938/1878] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:40 2022] DELETE /identity/v3/users/6f24b8de04f04fdbb2d2d5f9e760edce => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:40.667753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c02202-843e-4fa4-b26d-26414d3a22bc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.668109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c02202-843e-4fa4-b26d-26414d3a22bc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.668369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c02202-843e-4fa4-b26d-26414d3a22bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.687072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 941/1879] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:40.689985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104cb76-1343-4e53-96fb-b11cb11c6560 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:40.707778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-20c02202-843e-4fa4-b26d-26414d3a22bc None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:40.709457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-20c02202-843e-4fa4-b26d-26414d3a22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:40.723650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104cb76-1343-4e53-96fb-b11cb11c6560 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:40.827149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f16b1-e6da-4d64-8fbd-96f2bdd3b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:40.828181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f16b1-e6da-4d64-8fbd-96f2bdd3b88d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.828778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f16b1-e6da-4d64-8fbd-96f2bdd3b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.829278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f16b1-e6da-4d64-8fbd-96f2bdd3b88d admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.830219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f16b1-e6da-4d64-8fbd-96f2bdd3b88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:40.832191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f16b1-e6da-4d64-8fbd-96f2bdd3b88d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:40.853761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 942/1880] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:40.856231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f16b1-e6da-4d64-8fbd-96f2bdd3b88d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:40.870920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f16b1-e6da-4d64-8fbd-96f2bdd3b88d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:40.872871 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 939/1881] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:40.877294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54560dff-f6e6-4b3b-b590-356420fc1e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:40.878523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54560dff-f6e6-4b3b-b590-356420fc1e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.878954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54560dff-f6e6-4b3b-b590-356420fc1e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.879451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54560dff-f6e6-4b3b-b590-356420fc1e14 admin admin] PATH_INFO: `/v3/projects/2d35dff6544a40d7923fac39df8ab04e/users/1d801cde3e874b8582d61a4179d67707/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:40.901239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54560dff-f6e6-4b3b-b590-356420fc1e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d35dff6544a40d7923fac39df8ab04e, user_id=1d801cde3e874b8582d61a4179d67707, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:40.904883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54560dff-f6e6-4b3b-b590-356420fc1e14 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:40.906884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c02202-843e-4fa4-b26d-26414d3a22bc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:40.909991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-20c02202-843e-4fa4-b26d-26414d3a22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:40.930511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 943/1882] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:40 2022] PUT /identity/v3/projects/2d35dff6544a40d7923fac39df8ab04e/users/1d801cde3e874b8582d61a4179d67707/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:40.942178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98ec3-ae7d-40e5-886f-7b319d1e945c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:40.942370 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98ec3-ae7d-40e5-886f-7b319d1e945c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:40.943197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98ec3-ae7d-40e5-886f-7b319d1e945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:41.017703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-56d98ec3-ae7d-40e5-886f-7b319d1e945c None None] MFA Rules not processed for user `1d801cde3e874b8582d61a4179d67707`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:41.019243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-56d98ec3-ae7d-40e5-886f-7b319d1e945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:41.057696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c02202-843e-4fa4-b26d-26414d3a22bc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:41.191980 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c7e2-9ef4-4336-a5b0-ac7c05910c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:41.192730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c7e2-9ef4-4336-a5b0-ac7c05910c65 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:41.194551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c7e2-9ef4-4336-a5b0-ac7c05910c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:41.194855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c7e2-9ef4-4336-a5b0-ac7c05910c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:41.204635 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 944/1883] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:41.210094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d98ec3-ae7d-40e5-886f-7b319d1e945c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:41.303164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:41.319701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:41.331556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d98ec3-ae7d-40e5-886f-7b319d1e945c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:41.345424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b00b6-997c-4576-8f3a-ec5037485d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:41.346564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b00b6-997c-4576-8f3a-ec5037485d2d admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:41.346564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b00b6-997c-4576-8f3a-ec5037485d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:41.346982 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b00b6-997c-4576-8f3a-ec5037485d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:41.347795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b00b6-997c-4576-8f3a-ec5037485d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:41.350480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b00b6-997c-4576-8f3a-ec5037485d2d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:41.378209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14c7e2-9ef4-4336-a5b0-ac7c05910c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:41.382629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14c7e2-9ef4-4336-a5b0-ac7c05910c65 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:41.400030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 940/1884] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:41.429125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 945/1885] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:41 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:41.433102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c7e2-9ef4-4336-a5b0-ac7c05910c65 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:41.446810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c7e2-9ef4-4336-a5b0-ac7c05910c65 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:41.586357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285a24-3477-4bf2-8fc6-1df1cb597415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:41.587068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285a24-3477-4bf2-8fc6-1df1cb597415 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:41.587357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285a24-3477-4bf2-8fc6-1df1cb597415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:41.587639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285a24-3477-4bf2-8fc6-1df1cb597415 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:41.588375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285a24-3477-4bf2-8fc6-1df1cb597415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:41.590555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285a24-3477-4bf2-8fc6-1df1cb597415 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:41.627489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 941/1886] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:41 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:41.628734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b00b6-997c-4576-8f3a-ec5037485d2d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:41.644944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b00b6-997c-4576-8f3a-ec5037485d2d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:41.661316 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a624-0486-4e78-9251-4bc01aba095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:41.662083 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a624-0486-4e78-9251-4bc01aba095e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:41.662419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a624-0486-4e78-9251-4bc01aba095e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:41.662796 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a624-0486-4e78-9251-4bc01aba095e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:41.663647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004a624-0486-4e78-9251-4bc01aba095e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:41.665300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004a624-0486-4e78-9251-4bc01aba095e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:41.692102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 946/1887] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:41.694024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285a24-3477-4bf2-8fc6-1df1cb597415 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:41.714755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285a24-3477-4bf2-8fc6-1df1cb597415 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:41.722164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb28464-5601-4f87-84e9-2a91c4028f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:41.723037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28464-5601-4f87-84e9-2a91c4028f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:41.723326 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28464-5601-4f87-84e9-2a91c4028f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:41.723603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28464-5601-4f87-84e9-2a91c4028f69 admin admin] PATH_INFO: `/v3/projects/7e95e514cba24da391f15634992357a6/users/a630f5966ecd4a31994391490015f53d/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:41.753556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb28464-5601-4f87-84e9-2a91c4028f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e95e514cba24da391f15634992357a6, user_id=a630f5966ecd4a31994391490015f53d, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:41.756435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb28464-5601-4f87-84e9-2a91c4028f69 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:41.783080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 942/1888] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:41 2022] PUT /identity/v3/projects/7e95e514cba24da391f15634992357a6/users/a630f5966ecd4a31994391490015f53d/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:41.786873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a624-0486-4e78-9251-4bc01aba095e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:41.801551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a624-0486-4e78-9251-4bc01aba095e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:41.923235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef174791-ad27-46fe-91cb-888fb62cab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:41.924333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174791-ad27-46fe-91cb-888fb62cab0e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:41.924955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174791-ad27-46fe-91cb-888fb62cab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:41.925479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174791-ad27-46fe-91cb-888fb62cab0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:41.929318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef174791-ad27-46fe-91cb-888fb62cab0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:41.931864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef174791-ad27-46fe-91cb-888fb62cab0e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:41.950925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 947/1889] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:41.954743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb28464-5601-4f87-84e9-2a91c4028f69 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:41.968136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb28464-5601-4f87-84e9-2a91c4028f69 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:41.974784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2759585-1fe0-48ea-bfa4-a7803483ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:41.975848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2759585-1fe0-48ea-bfa4-a7803483ea70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:41.976181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2759585-1fe0-48ea-bfa4-a7803483ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:41.976459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2759585-1fe0-48ea-bfa4-a7803483ea70 admin admin] PATH_INFO: `/v3/projects/7e95e514cba24da391f15634992357a6/users/a630f5966ecd4a31994391490015f53d/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:41.978659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2759585-1fe0-48ea-bfa4-a7803483ea70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e95e514cba24da391f15634992357a6, user_id=a630f5966ecd4a31994391490015f53d, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:41.981488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2759585-1fe0-48ea-bfa4-a7803483ea70 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:42.003615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 943/1890] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:41 2022] PUT /identity/v3/projects/7e95e514cba24da391f15634992357a6/users/a630f5966ecd4a31994391490015f53d/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:42.006827 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac291cf8-d6bb-4f26-9de8-b8aaa016779f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:42.006827 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac291cf8-d6bb-4f26-9de8-b8aaa016779f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:42.006827 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac291cf8-d6bb-4f26-9de8-b8aaa016779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:42.173176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ac291cf8-d6bb-4f26-9de8-b8aaa016779f None None] MFA Rules not processed for user `a630f5966ecd4a31994391490015f53d`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:42.174496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ac291cf8-d6bb-4f26-9de8-b8aaa016779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:42.393785 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 948/1891] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:42.406893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2759585-1fe0-48ea-bfa4-a7803483ea70 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:42.409108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a2759585-1fe0-48ea-bfa4-a7803483ea70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:42.525568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2759585-1fe0-48ea-bfa4-a7803483ea70 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:42.532981 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19fd47-bcb8-4152-a01c-1c1301e2f2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:42.533660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19fd47-bcb8-4152-a01c-1c1301e2f2ae service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:42.533950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19fd47-bcb8-4152-a01c-1c1301e2f2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:42.534232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19fd47-bcb8-4152-a01c-1c1301e2f2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:42.576305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19fd47-bcb8-4152-a01c-1c1301e2f2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:42.579091 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19fd47-bcb8-4152-a01c-1c1301e2f2ae service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:42.607236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 944/1892] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:42.624821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac291cf8-d6bb-4f26-9de8-b8aaa016779f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:42.626290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ac291cf8-d6bb-4f26-9de8-b8aaa016779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:42.721689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:42.746636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac291cf8-d6bb-4f26-9de8-b8aaa016779f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:42.752072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:42.753509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:42.753860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:42.754209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] PATH_INFO: `/v3/projects/0c33fb0a44b64007b3a7d25798c2f8d0` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:42.756963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c33fb0a44b64007b3a7d25798c2f8d0)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:42.759340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:42.843768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c33fb0a44b64007b3a7d25798c2f8d0', 'request_id': 'req-960e68c6-1d94-4e4e-803d-2eb839b88a89'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:42.866472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c33fb0a44b64007b3a7d25798c2f8d0', 'request_id': 'req-960e68c6-1d94-4e4e-803d-2eb839b88a89'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:42.891293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c33fb0a44b64007b3a7d25798c2f8d0', 'request_id': 'req-960e68c6-1d94-4e4e-803d-2eb839b88a89'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:42.905117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] The token cache is being invalidate because project 0c33fb0a44b64007b3a7d25798c2f8d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:42.905415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:42.906090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:42.908054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 949/1893] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:42 2022] DELETE /identity/v3/projects/0c33fb0a44b64007b3a7d25798c2f8d0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:42.914883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19fd47-bcb8-4152-a01c-1c1301e2f2ae service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:42.956221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19fd47-bcb8-4152-a01c-1c1301e2f2ae service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:43.028484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:43.142897 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:43.145763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:43.147639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:43.148158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] PATH_INFO: `/v3/users/582e09b213004b4c8fb09cbf4ea153b5` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:43.151361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=582e09b213004b4c8fb09cbf4ea153b5)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:43.159821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:43.307511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582e09b213004b4c8fb09cbf4ea153b5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:43.321186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582e09b213004b4c8fb09cbf4ea153b5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:43.322767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582e09b213004b4c8fb09cbf4ea153b5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:43.349678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582e09b213004b4c8fb09cbf4ea153b5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:43.350582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582e09b213004b4c8fb09cbf4ea153b5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:43.383947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 945/1894] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:42 2022] DELETE /identity/v3/users/582e09b213004b4c8fb09cbf4ea153b5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:43.765810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:43.768079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:43.784944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e68c6-1d94-4e4e-803d-2eb839b88a89 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:43.872865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:43.875180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:43.876057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:43.876617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] PATH_INFO: `/v3/users/1d801cde3e874b8582d61a4179d67707` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:43.878584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d801cde3e874b8582d61a4179d67707)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:43.883311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:43.984501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d801cde3e874b8582d61a4179d67707'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:43.992980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d801cde3e874b8582d61a4179d67707'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.000340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.002358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:44.017266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49821a6a-2578-42f4-98c3-a351807177e3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.022795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.024083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.024706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.024987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] PATH_INFO: `/v3/projects/1e84ba8ea25f4b0a94eeb66450304470` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.025564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d801cde3e874b8582d61a4179d67707'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.026478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e84ba8ea25f4b0a94eeb66450304470)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.026603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d801cde3e874b8582d61a4179d67707'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.027361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fac5ad44-30bc-4936-a4f6-fa62252f05fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d801cde3e874b8582d61a4179d67707'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.028410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.041990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 950/1895] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:43 2022] DELETE /identity/v3/users/1d801cde3e874b8582d61a4179d67707 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:44.046583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600f3dd-affa-4f58-9229-53f1120cb681 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.046876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600f3dd-affa-4f58-9229-53f1120cb681 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.047159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600f3dd-affa-4f58-9229-53f1120cb681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.053153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:44.069019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6600f3dd-affa-4f58-9229-53f1120cb681 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:44.070624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6600f3dd-affa-4f58-9229-53f1120cb681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:44.083991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e84ba8ea25f4b0a94eeb66450304470', 'request_id': 'req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.090684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e84ba8ea25f4b0a94eeb66450304470', 'request_id': 'req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.096798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e84ba8ea25f4b0a94eeb66450304470', 'request_id': 'req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.111618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] The token cache is being invalidate because project 1e84ba8ea25f4b0a94eeb66450304470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:44.111937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.112611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d769de9-5279-4c6b-8eaf-f1d397e5bc4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.114246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 946/1896] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:43 2022] DELETE /identity/v3/projects/1e84ba8ea25f4b0a94eeb66450304470 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:44.119402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c780-278e-4931-8a59-7fb1a1bf9886 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.119723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c780-278e-4931-8a59-7fb1a1bf9886 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.120045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c780-278e-4931-8a59-7fb1a1bf9886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.138370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c199c780-278e-4931-8a59-7fb1a1bf9886 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:44.139671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c199c780-278e-4931-8a59-7fb1a1bf9886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:44.142953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 951/1897] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:44.149461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 947/1898] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:44.154620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600f3dd-affa-4f58-9229-53f1120cb681 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.156129 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6600f3dd-affa-4f58-9229-53f1120cb681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:44.157487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc44f2-8d68-4bdb-a4db-cb160e0cd34a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.157853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc44f2-8d68-4bdb-a4db-cb160e0cd34a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.158207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc44f2-8d68-4bdb-a4db-cb160e0cd34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.178081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-42dc44f2-8d68-4bdb-a4db-cb160e0cd34a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:44.179290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-42dc44f2-8d68-4bdb-a4db-cb160e0cd34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:44.187239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 948/1899] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:44.191460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc44f2-8d68-4bdb-a4db-cb160e0cd34a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.201340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc44f2-8d68-4bdb-a4db-cb160e0cd34a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.205895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63350cf2-19dd-4bf5-859e-33f57914fff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.206546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63350cf2-19dd-4bf5-859e-33f57914fff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.206833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63350cf2-19dd-4bf5-859e-33f57914fff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.207118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63350cf2-19dd-4bf5-859e-33f57914fff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.207858 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63350cf2-19dd-4bf5-859e-33f57914fff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:44.209046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63350cf2-19dd-4bf5-859e-33f57914fff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.210886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63350cf2-19dd-4bf5-859e-33f57914fff8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.213082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:44.217308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600f3dd-affa-4f58-9229-53f1120cb681 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.221174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f30344-2454-4c7e-aadf-f51506383688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.221922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f30344-2454-4c7e-aadf-f51506383688 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.222269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f30344-2454-4c7e-aadf-f51506383688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.222485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f30344-2454-4c7e-aadf-f51506383688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.226229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 949/1900] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:12:44.232944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63350cf2-19dd-4bf5-859e-33f57914fff8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.233366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f30344-2454-4c7e-aadf-f51506383688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.235437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f30344-2454-4c7e-aadf-f51506383688 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.244090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63350cf2-19dd-4bf5-859e-33f57914fff8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.246667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 952/1901] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:44.251262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e59dc-d26d-4190-bc71-b8d689c59b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.252098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e59dc-d26d-4190-bc71-b8d689c59b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.252389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e59dc-d26d-4190-bc71-b8d689c59b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.252856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e59dc-d26d-4190-bc71-b8d689c59b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.253421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e59dc-d26d-4190-bc71-b8d689c59b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.256071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e59dc-d26d-4190-bc71-b8d689c59b99 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.293540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 950/1902] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:44 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:44.295027 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f30344-2454-4c7e-aadf-f51506383688 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.305106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f30344-2454-4c7e-aadf-f51506383688 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.377275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472567c-e36c-494a-9075-8bde33cb7c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.377978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472567c-e36c-494a-9075-8bde33cb7c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.378713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472567c-e36c-494a-9075-8bde33cb7c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.379062 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472567c-e36c-494a-9075-8bde33cb7c23 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.379952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472567c-e36c-494a-9075-8bde33cb7c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.382763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472567c-e36c-494a-9075-8bde33cb7c23 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.407859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 953/1903] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:44 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:44.412790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e59dc-d26d-4190-bc71-b8d689c59b99 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.424671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e59dc-d26d-4190-bc71-b8d689c59b99 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.430337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf676b5-8717-49c6-80c6-17619c6e450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.431018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf676b5-8717-49c6-80c6-17619c6e450a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.431789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf676b5-8717-49c6-80c6-17619c6e450a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.431789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf676b5-8717-49c6-80c6-17619c6e450a admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.432332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf676b5-8717-49c6-80c6-17619c6e450a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.434235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf676b5-8717-49c6-80c6-17619c6e450a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.447220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 951/1904] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:44.451486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472567c-e36c-494a-9075-8bde33cb7c23 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.463483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472567c-e36c-494a-9075-8bde33cb7c23 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.482170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eb76b-1d8a-463b-8405-5052a7bace15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.483046 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eb76b-1d8a-463b-8405-5052a7bace15 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.483178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eb76b-1d8a-463b-8405-5052a7bace15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.483440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eb76b-1d8a-463b-8405-5052a7bace15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.484351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9eb76b-1d8a-463b-8405-5052a7bace15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.486100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9eb76b-1d8a-463b-8405-5052a7bace15 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.500072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 954/1905] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:12:44.504256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf676b5-8717-49c6-80c6-17619c6e450a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.514655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf676b5-8717-49c6-80c6-17619c6e450a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.520043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587f650-5d23-4424-8361-b30aa1a0db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.521010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587f650-5d23-4424-8361-b30aa1a0db42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.521319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587f650-5d23-4424-8361-b30aa1a0db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.521744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587f650-5d23-4424-8361-b30aa1a0db42 admin admin] PATH_INFO: `/v3/projects/c2ed7e9f2ace469c8f83c51b0e2ba57d/users/d35e17f0fecd43fe900860ad108d8e9c/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.537980 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587f650-5d23-4424-8361-b30aa1a0db42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ed7e9f2ace469c8f83c51b0e2ba57d, user_id=d35e17f0fecd43fe900860ad108d8e9c, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.540657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587f650-5d23-4424-8361-b30aa1a0db42 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.559586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 952/1906] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:44 2022] PUT /identity/v3/projects/c2ed7e9f2ace469c8f83c51b0e2ba57d/users/d35e17f0fecd43fe900860ad108d8e9c/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:44.563031 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e1f4b-ee7c-4ea3-b5fe-f41317de59df None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.563326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e1f4b-ee7c-4ea3-b5fe-f41317de59df None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.563605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e1f4b-ee7c-4ea3-b5fe-f41317de59df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.582975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0d4e1f4b-ee7c-4ea3-b5fe-f41317de59df None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:44.585164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0d4e1f4b-ee7c-4ea3-b5fe-f41317de59df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:44.616195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:44.689738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 955/1907] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:44.696956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587f650-5d23-4424-8361-b30aa1a0db42 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.710493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e1f4b-ee7c-4ea3-b5fe-f41317de59df None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.711941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0d4e1f4b-ee7c-4ea3-b5fe-f41317de59df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:44.737055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e1f4b-ee7c-4ea3-b5fe-f41317de59df None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.749905 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.750706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.750989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.751266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] PATH_INFO: `/v3/projects/2d35dff6544a40d7923fac39df8ab04e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.754059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d35dff6544a40d7923fac39df8ab04e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.756984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.812017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587f650-5d23-4424-8361-b30aa1a0db42 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.816142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d35dff6544a40d7923fac39df8ab04e', 'request_id': 'req-cce05def-e3c9-4e70-adc7-fd8aa145feb7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.823181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d35dff6544a40d7923fac39df8ab04e', 'request_id': 'req-cce05def-e3c9-4e70-adc7-fd8aa145feb7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.837065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d35dff6544a40d7923fac39df8ab04e', 'request_id': 'req-cce05def-e3c9-4e70-adc7-fd8aa145feb7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.851566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] The token cache is being invalidate because project 2d35dff6544a40d7923fac39df8ab04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:44.852032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.852788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:44.854711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 956/1908] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:44 2022] DELETE /identity/v3/projects/2d35dff6544a40d7923fac39df8ab04e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:44.859398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:44.861365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:44.888437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.889239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.889544 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.889815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.891803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:44.969521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce05def-e3c9-4e70-adc7-fd8aa145feb7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:44.975184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:44.976212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:44.976498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:44.977146 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] PATH_INFO: `/v3/users/a630f5966ecd4a31994391490015f53d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:44.978305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a630f5966ecd4a31994391490015f53d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.980559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:44.988194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:44.993437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:45.036323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 953/1909] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:45.093048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a630f5966ecd4a31994391490015f53d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.097117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:45.116614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a630f5966ecd4a31994391490015f53d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.137588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a630f5966ecd4a31994391490015f53d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.138697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a630f5966ecd4a31994391490015f53d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.139468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a630f5966ecd4a31994391490015f53d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.157746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 957/1910] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:44 2022] DELETE /identity/v3/users/a630f5966ecd4a31994391490015f53d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:45.314165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:45.315859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:45.324207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:45.330499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec3985-af59-4621-9c3a-55aa5ee8a1a7 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:45.413831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:45.415027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:45.415456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:45.416494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] PATH_INFO: `/v3/users/b5f2b09ee27943359a4fc5f87d5f797a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:45.418260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f2b09ee27943359a4fc5f87d5f797a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:45.421491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:45.487644 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:45.489242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:45.494151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f2b09ee27943359a4fc5f87d5f797a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.518032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765555ec-47f1-4cac-8660-845a26001d9f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:45.526833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:45.526978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f2b09ee27943359a4fc5f87d5f797a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.528120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f2b09ee27943359a4fc5f87d5f797a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.531562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:45.533388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:45.534876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] PATH_INFO: `/v3/projects/7e95e514cba24da391f15634992357a6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:45.541789 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e95e514cba24da391f15634992357a6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:45.547939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:45.570057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f2b09ee27943359a4fc5f87d5f797a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.572117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-b6d2932e-6c1b-4ec8-8a5c-9371521f39d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f2b09ee27943359a4fc5f87d5f797a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.607994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 954/1911] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:45 2022] DELETE /identity/v3/users/b5f2b09ee27943359a4fc5f87d5f797a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:45.611150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc771-d176-4afc-9b02-e49e8d7f6dfe None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:45.611497 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc771-d176-4afc-9b02-e49e8d7f6dfe None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:45.612077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc771-d176-4afc-9b02-e49e8d7f6dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:45.640643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-aa9cc771-d176-4afc-9b02-e49e8d7f6dfe None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:45.641970 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-aa9cc771-d176-4afc-9b02-e49e8d7f6dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:45.692530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e95e514cba24da391f15634992357a6', 'request_id': 'req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.714794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e95e514cba24da391f15634992357a6', 'request_id': 'req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.731809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e95e514cba24da391f15634992357a6', 'request_id': 'req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.760947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] The token cache is being invalidate because project 7e95e514cba24da391f15634992357a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:45.761330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.762131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-bb7bdc1d-5a9e-4d66-b9a7-a23f2c8d3eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:45.764563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 958/1912] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:45 2022] DELETE /identity/v3/projects/7e95e514cba24da391f15634992357a6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:45.767576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 955/1913] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:45.769569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5165f7-9fe9-46ea-ba46-3d85382ad376 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:45.769870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5165f7-9fe9-46ea-ba46-3d85382ad376 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:45.770210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5165f7-9fe9-46ea-ba46-3d85382ad376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:45.776470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cc771-d176-4afc-9b02-e49e8d7f6dfe None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:45.779587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-aa9cc771-d176-4afc-9b02-e49e8d7f6dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:45.793263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8a5165f7-9fe9-46ea-ba46-3d85382ad376 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:45.794715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8a5165f7-9fe9-46ea-ba46-3d85382ad376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:45.804417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 959/1914] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:45.813760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54080fe-893e-46d1-8c72-5f27bb739ca3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:45.814054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54080fe-893e-46d1-8c72-5f27bb739ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:45.814707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54080fe-893e-46d1-8c72-5f27bb739ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:45.825618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:45.837335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-e54080fe-893e-46d1-8c72-5f27bb739ca3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:45.839467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e54080fe-893e-46d1-8c72-5f27bb739ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:45.857227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 960/1915] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:45.858626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54080fe-893e-46d1-8c72-5f27bb739ca3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:45.870953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54080fe-893e-46d1-8c72-5f27bb739ca3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:45.877963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01ef2-0f66-4949-a932-a1c17a49eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:45.878976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01ef2-0f66-4949-a932-a1c17a49eb8e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:45.879406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01ef2-0f66-4949-a932-a1c17a49eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:45.879825 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01ef2-0f66-4949-a932-a1c17a49eb8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:45.880817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc01ef2-0f66-4949-a932-a1c17a49eb8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:45.881273 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc01ef2-0f66-4949-a932-a1c17a49eb8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:45.883070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc01ef2-0f66-4949-a932-a1c17a49eb8e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:45.884648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cc771-d176-4afc-9b02-e49e8d7f6dfe None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:45.896983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7fc11-ddb5-4e6f-9771-96e77c526764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:45.897840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7fc11-ddb5-4e6f-9771-96e77c526764 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:45.898381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7fc11-ddb5-4e6f-9771-96e77c526764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:45.898775 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7fc11-ddb5-4e6f-9771-96e77c526764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:45.902806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-27f7fc11-ddb5-4e6f-9771-96e77c526764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:45.903018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 961/1916] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:45.905130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01ef2-0f66-4949-a932-a1c17a49eb8e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:45.916088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01ef2-0f66-4949-a932-a1c17a49eb8e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:45.922628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ec5bb-d444-4320-812c-17845bbacb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:45.922628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ec5bb-d444-4320-812c-17845bbacb01 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:45.923072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ec5bb-d444-4320-812c-17845bbacb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:45.923417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ec5bb-d444-4320-812c-17845bbacb01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:45.924275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ec5bb-d444-4320-812c-17845bbacb01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:45.926283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ec5bb-d444-4320-812c-17845bbacb01 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:45.940281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7fc11-ddb5-4e6f-9771-96e77c526764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:45.942360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7fc11-ddb5-4e6f-9771-96e77c526764 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:45.966903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 962/1917] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:45 2022] POST /identity/v3/projects => generated 361 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:45.968138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ec5bb-d444-4320-812c-17845bbacb01 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:45.968504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 956/1918] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:46.007984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce744f-2c61-43f4-bb95-3329a70b064b None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.008687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce744f-2c61-43f4-bb95-3329a70b064b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.009267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce744f-2c61-43f4-bb95-3329a70b064b None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.011197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 957/1919] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:12:46.031688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7590de-b9bf-44b1-ae63-70f3872f9a9a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.032248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7590de-b9bf-44b1-ae63-70f3872f9a9a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.032740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7590de-b9bf-44b1-ae63-70f3872f9a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.054938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ec5bb-d444-4320-812c-17845bbacb01 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:46.062204 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036267b-481c-4139-8f01-6a45ac11c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:46.063226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036267b-481c-4139-8f01-6a45ac11c2ed admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.063845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036267b-481c-4139-8f01-6a45ac11c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.064177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036267b-481c-4139-8f01-6a45ac11c2ed admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.065326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036267b-481c-4139-8f01-6a45ac11c2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:46.068360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036267b-481c-4139-8f01-6a45ac11c2ed admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:46.073052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6a7590de-b9bf-44b1-ae63-70f3872f9a9a None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:46.074342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6a7590de-b9bf-44b1-ae63-70f3872f9a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:46.078878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:46.106688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 963/1920] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:45 2022] POST /identity/v3/users => generated 281 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:46.108872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036267b-481c-4139-8f01-6a45ac11c2ed admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:46.135175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036267b-481c-4139-8f01-6a45ac11c2ed admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:46.154948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbaef5-2802-4e11-bc26-6f1a3623c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:46.157403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbaef5-2802-4e11-bc26-6f1a3623c184 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.158044 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbaef5-2802-4e11-bc26-6f1a3623c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.159361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbaef5-2802-4e11-bc26-6f1a3623c184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.166809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbaef5-2802-4e11-bc26-6f1a3623c184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:46.173155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbaef5-2802-4e11-bc26-6f1a3623c184 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:46.206494 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 964/1921] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:46.217130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbaef5-2802-4e11-bc26-6f1a3623c184 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:46.235122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbaef5-2802-4e11-bc26-6f1a3623c184 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:46.265857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b859a84-96e4-4b9a-aac8-3ae27f406570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:46.266598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859a84-96e4-4b9a-aac8-3ae27f406570 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.266851 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859a84-96e4-4b9a-aac8-3ae27f406570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.267149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b859a84-96e4-4b9a-aac8-3ae27f406570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.267924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b859a84-96e4-4b9a-aac8-3ae27f406570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:46.274068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b859a84-96e4-4b9a-aac8-3ae27f406570 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:46.327135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 958/1922] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:12:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:46.327483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 965/1923] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:46.331541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7590de-b9bf-44b1-ae63-70f3872f9a9a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:46.375108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7590de-b9bf-44b1-ae63-70f3872f9a9a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:46.388514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b859a84-96e4-4b9a-aac8-3ae27f406570 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:46.390307 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4b859a84-96e4-4b9a-aac8-3ae27f406570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:46.402705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ae3e5-0655-4df5-b816-52c4dda782ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:46.406082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ae3e5-0655-4df5-b816-52c4dda782ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.410027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ae3e5-0655-4df5-b816-52c4dda782ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.410425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ae3e5-0655-4df5-b816-52c4dda782ee admin admin] PATH_INFO: `/v3/projects/405f11b9cc1c49ffab69d1497ee3f14b/users/c034d7f17fb64063a804a662faab9765/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.425681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b859a84-96e4-4b9a-aac8-3ae27f406570 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:46.439935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ae3e5-0655-4df5-b816-52c4dda782ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=405f11b9cc1c49ffab69d1497ee3f14b, user_id=c034d7f17fb64063a804a662faab9765, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:46.444505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ae3e5-0655-4df5-b816-52c4dda782ee admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:46.457708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2331-da2c-4274-b15e-3f2da15599a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:46.458724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2331-da2c-4274-b15e-3f2da15599a3 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.459888 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2331-da2c-4274-b15e-3f2da15599a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.460201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2331-da2c-4274-b15e-3f2da15599a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.472046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 959/1924] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:46 2022] PUT /identity/v3/projects/405f11b9cc1c49ffab69d1497ee3f14b/users/c034d7f17fb64063a804a662faab9765/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:12:46.478159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c619-39a9-429d-9887-86722546b279 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.478463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c619-39a9-429d-9887-86722546b279 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.478831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c619-39a9-429d-9887-86722546b279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.500944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab2331-da2c-4274-b15e-3f2da15599a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:46.501596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab2331-da2c-4274-b15e-3f2da15599a3 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:46.522002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3fc6c619-39a9-429d-9887-86722546b279 None None] MFA Rules not processed for user `c034d7f17fb64063a804a662faab9765`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:46.524013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3fc6c619-39a9-429d-9887-86722546b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:46.537362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 966/1925] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:46.603760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2331-da2c-4274-b15e-3f2da15599a3 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:46.605379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-90ab2331-da2c-4274-b15e-3f2da15599a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:46.636124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 960/1926] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:46.641320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2331-da2c-4274-b15e-3f2da15599a3 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:46.675186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c619-39a9-429d-9887-86722546b279 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:46.676965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3fc6c619-39a9-429d-9887-86722546b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:46.769210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:46.860810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c619-39a9-429d-9887-86722546b279 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:46.868604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:46.870122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.871763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.872401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] PATH_INFO: `/v3/projects/1a88d764ad5c435b8c0f9c6e9ff3ddf1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.874236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a19cf-31c9-484f-8fec-0b4632d1bfb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:46.874683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a88d764ad5c435b8c0f9c6e9ff3ddf1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:46.875404 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a19cf-31c9-484f-8fec-0b4632d1bfb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.875834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a19cf-31c9-484f-8fec-0b4632d1bfb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.876303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a19cf-31c9-484f-8fec-0b4632d1bfb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.879317 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:46.898218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a19cf-31c9-484f-8fec-0b4632d1bfb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:46.901101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a19cf-31c9-484f-8fec-0b4632d1bfb2 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:46.913184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 961/1927] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:46.930199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a19cf-31c9-484f-8fec-0b4632d1bfb2 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:46.948560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a19cf-31c9-484f-8fec-0b4632d1bfb2 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:46.963074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:46.964337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:46.964910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:46.966390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] PATH_INFO: `/v3/users/c034d7f17fb64063a804a662faab9765` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:46.968847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c034d7f17fb64063a804a662faab9765)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:46.972428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:47.011103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a88d764ad5c435b8c0f9c6e9ff3ddf1', 'request_id': 'req-c5be55c3-3dbe-4644-a222-05c276432731'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.025242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a88d764ad5c435b8c0f9c6e9ff3ddf1', 'request_id': 'req-c5be55c3-3dbe-4644-a222-05c276432731'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.037187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c034d7f17fb64063a804a662faab9765'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.040596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a88d764ad5c435b8c0f9c6e9ff3ddf1', 'request_id': 'req-c5be55c3-3dbe-4644-a222-05c276432731'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.047137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c034d7f17fb64063a804a662faab9765'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.048065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c034d7f17fb64063a804a662faab9765'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.060187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] The token cache is being invalidate because project 1a88d764ad5c435b8c0f9c6e9ff3ddf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:47.060995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.062117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.068820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 967/1928] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:46 2022] DELETE /identity/v3/projects/1a88d764ad5c435b8c0f9c6e9ff3ddf1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:47.069824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c034d7f17fb64063a804a662faab9765'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.070640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:47.070810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-70d37e8b-2cc7-4909-a617-9cf9c486ccd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c034d7f17fb64063a804a662faab9765'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.072719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:47.096794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 962/1929] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:46 2022] DELETE /identity/v3/users/c034d7f17fb64063a804a662faab9765 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:47.102091 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20363f91-2c1b-4d84-bf55-0e69fef0d81d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:47.102506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20363f91-2c1b-4d84-bf55-0e69fef0d81d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:47.102972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20363f91-2c1b-4d84-bf55-0e69fef0d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:47.127946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-20363f91-2c1b-4d84-bf55-0e69fef0d81d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:47.131128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-20363f91-2c1b-4d84-bf55-0e69fef0d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:47.177545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:47.202567 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be55c3-3dbe-4644-a222-05c276432731 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:47.300401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:47.301514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:47.301786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:47.302385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] PATH_INFO: `/v3/users/7b657636e4bb42239114f9063dbf291d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:47.303826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b657636e4bb42239114f9063dbf291d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:47.304005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 963/1930] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:47.306085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:47.306789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0ade-4a8a-466a-9ac4-a137a0fd3f9a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:47.321834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0ade-4a8a-466a-9ac4-a137a0fd3f9a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:47.322613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0ade-4a8a-466a-9ac4-a137a0fd3f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:47.399368 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-592e0ade-4a8a-466a-9ac4-a137a0fd3f9a None None] MFA Rules not processed for user `d35e17f0fecd43fe900860ad108d8e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:47.400968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b657636e4bb42239114f9063dbf291d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.401155 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-592e0ade-4a8a-466a-9ac4-a137a0fd3f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:47.414807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b657636e4bb42239114f9063dbf291d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.439649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b657636e4bb42239114f9063dbf291d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.441707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b657636e4bb42239114f9063dbf291d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.442398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b657636e4bb42239114f9063dbf291d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:47.451735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:47.479616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 968/1931] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:47 2022] DELETE /identity/v3/users/7b657636e4bb42239114f9063dbf291d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:47.481001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:47.482401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:47.521348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 964/1932] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:47.527156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e0ade-4a8a-466a-9ac4-a137a0fd3f9a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:47.529158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-592e0ade-4a8a-466a-9ac4-a137a0fd3f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:47.545510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e0ade-4a8a-466a-9ac4-a137a0fd3f9a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:47.552617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378a427-2b46-4881-ab87-9e60eba0ffd1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:47.560934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395585d0-3a2b-4f5b-8a6d-fb040ebf9a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:47.561626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395585d0-3a2b-4f5b-8a6d-fb040ebf9a1c service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:47.561872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395585d0-3a2b-4f5b-8a6d-fb040ebf9a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:47.562148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395585d0-3a2b-4f5b-8a6d-fb040ebf9a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:47.563970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-395585d0-3a2b-4f5b-8a6d-fb040ebf9a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:47.596700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:47.642958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97c166-ec96-4d78-9487-3e7207e11d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:47.643643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c166-ec96-4d78-9487-3e7207e11d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:47.643940 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c166-ec96-4d78-9487-3e7207e11d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:47.644224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c166-ec96-4d78-9487-3e7207e11d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:47.644928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97c166-ec96-4d78-9487-3e7207e11d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:47.647092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97c166-ec96-4d78-9487-3e7207e11d52 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:47.667784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395585d0-3a2b-4f5b-8a6d-fb040ebf9a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:47.669437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395585d0-3a2b-4f5b-8a6d-fb040ebf9a1c service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:47.681276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 965/1933] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:47 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:47.684906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97c166-ec96-4d78-9487-3e7207e11d52 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:47.685150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 969/1934] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:47.794891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97c166-ec96-4d78-9487-3e7207e11d52 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:47.800370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653d3e-c8b5-48c0-a567-4d68be8617cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:47.801309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653d3e-c8b5-48c0-a567-4d68be8617cb admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:47.801786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653d3e-c8b5-48c0-a567-4d68be8617cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:47.803592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653d3e-c8b5-48c0-a567-4d68be8617cb admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:47.804714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de653d3e-c8b5-48c0-a567-4d68be8617cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:47.807464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de653d3e-c8b5-48c0-a567-4d68be8617cb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:47.846384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395585d0-3a2b-4f5b-8a6d-fb040ebf9a1c service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:47.854082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 966/1935] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:47 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:12:47.860817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395585d0-3a2b-4f5b-8a6d-fb040ebf9a1c service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:47.868430 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44f48-2ef1-4154-9b7a-83b5976ac416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:47.869246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44f48-2ef1-4154-9b7a-83b5976ac416 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:47.869949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44f48-2ef1-4154-9b7a-83b5976ac416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:47.869949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44f48-2ef1-4154-9b7a-83b5976ac416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:47.870928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d44f48-2ef1-4154-9b7a-83b5976ac416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:47.872898 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d44f48-2ef1-4154-9b7a-83b5976ac416 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:47.888066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 970/1936] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:47.892487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653d3e-c8b5-48c0-a567-4d68be8617cb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:47.905364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653d3e-c8b5-48c0-a567-4d68be8617cb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:47.910885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f4a8e-65d7-40f5-a2a4-743d950b3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:47.912665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f4a8e-65d7-40f5-a2a4-743d950b3b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:47.913058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f4a8e-65d7-40f5-a2a4-743d950b3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:47.913411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f4a8e-65d7-40f5-a2a4-743d950b3b07 admin admin] PATH_INFO: `/v3/projects/c14754e135504a40959ed74fe9f133c1/users/9180a2ba34ec4d659d4ff3da263408d3/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:47.932577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44f48-2ef1-4154-9b7a-83b5976ac416 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:47.934841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a4d44f48-2ef1-4154-9b7a-83b5976ac416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:47.955420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f4a8e-65d7-40f5-a2a4-743d950b3b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14754e135504a40959ed74fe9f133c1, user_id=9180a2ba34ec4d659d4ff3da263408d3, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:47.958576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f4a8e-65d7-40f5-a2a4-743d950b3b07 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:47.961296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44f48-2ef1-4154-9b7a-83b5976ac416 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:47.970022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:47.970955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:47.971320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:47.971608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] PATH_INFO: `/v3/projects/3e102f1db7e640129b81a59cd20ebc46` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:47.973320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e102f1db7e640129b81a59cd20ebc46)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:47.978519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:47.996596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 967/1937] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:47 2022] PUT /identity/v3/projects/c14754e135504a40959ed74fe9f133c1/users/9180a2ba34ec4d659d4ff3da263408d3/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:47.997965 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f4a8e-65d7-40f5-a2a4-743d950b3b07 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.047986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:48.078634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e102f1db7e640129b81a59cd20ebc46', 'request_id': 'req-93a297a3-9013-4794-b9a4-67da854d82a4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.103151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e102f1db7e640129b81a59cd20ebc46', 'request_id': 'req-93a297a3-9013-4794-b9a4-67da854d82a4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.125422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e102f1db7e640129b81a59cd20ebc46', 'request_id': 'req-93a297a3-9013-4794-b9a4-67da854d82a4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.143283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f4a8e-65d7-40f5-a2a4-743d950b3b07 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.165056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] The token cache is being invalidate because project 3e102f1db7e640129b81a59cd20ebc46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:48.165368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.166269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-93a297a3-9013-4794-b9a4-67da854d82a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.169587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 971/1938] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:47 2022] DELETE /identity/v3/projects/3e102f1db7e640129b81a59cd20ebc46 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:48.174345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbb2a3-8275-4cbe-bdce-f8727299b56a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.176039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbb2a3-8275-4cbe-bdce-f8727299b56a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.177520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbb2a3-8275-4cbe-bdce-f8727299b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.220213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-51bbb2a3-8275-4cbe-bdce-f8727299b56a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:48.221603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-51bbb2a3-8275-4cbe-bdce-f8727299b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:48.259473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100166cc-c777-4055-8670-c71eecfd4c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.262613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100166cc-c777-4055-8670-c71eecfd4c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.263047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100166cc-c777-4055-8670-c71eecfd4c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.265502 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100166cc-c777-4055-8670-c71eecfd4c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.267489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100166cc-c777-4055-8670-c71eecfd4c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:48.271207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100166cc-c777-4055-8670-c71eecfd4c7f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:48.304923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 968/1939] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:48.305740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100166cc-c777-4055-8670-c71eecfd4c7f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.307702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-100166cc-c777-4055-8670-c71eecfd4c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:48.329127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100166cc-c777-4055-8670-c71eecfd4c7f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.332708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 972/1940] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:48.334696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbb2a3-8275-4cbe-bdce-f8727299b56a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.340933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-51bbb2a3-8275-4cbe-bdce-f8727299b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:48.342305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.343192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.343473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.343754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] PATH_INFO: `/v3/projects/405f11b9cc1c49ffab69d1497ee3f14b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.345171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=405f11b9cc1c49ffab69d1497ee3f14b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:48.347460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:48.355940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbb2a3-8275-4cbe-bdce-f8727299b56a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.366367 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9457ddd-d702-41c2-8670-c550163b8ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.367354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9457ddd-d702-41c2-8670-c550163b8ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.367650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9457ddd-d702-41c2-8670-c550163b8ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.367961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9457ddd-d702-41c2-8670-c550163b8ca9 admin admin] PATH_INFO: `/v3/projects/c14754e135504a40959ed74fe9f133c1/users/9180a2ba34ec4d659d4ff3da263408d3/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.371410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9457ddd-d702-41c2-8670-c550163b8ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14754e135504a40959ed74fe9f133c1, user_id=9180a2ba34ec4d659d4ff3da263408d3, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:48.374549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9457ddd-d702-41c2-8670-c550163b8ca9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:48.391982 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 973/1941] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:48 2022] PUT /identity/v3/projects/c14754e135504a40959ed74fe9f133c1/users/9180a2ba34ec4d659d4ff3da263408d3/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:48.393808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454805ce-e577-4973-9aaf-a99aaaacd4ab None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.394213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454805ce-e577-4973-9aaf-a99aaaacd4ab None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.394607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454805ce-e577-4973-9aaf-a99aaaacd4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.434736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-454805ce-e577-4973-9aaf-a99aaaacd4ab None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:48.436931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-454805ce-e577-4973-9aaf-a99aaaacd4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:48.455401 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405f11b9cc1c49ffab69d1497ee3f14b', 'request_id': 'req-08046e7e-18a4-46bb-bf02-bea1b0909a5f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.465793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405f11b9cc1c49ffab69d1497ee3f14b', 'request_id': 'req-08046e7e-18a4-46bb-bf02-bea1b0909a5f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.474553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405f11b9cc1c49ffab69d1497ee3f14b', 'request_id': 'req-08046e7e-18a4-46bb-bf02-bea1b0909a5f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.482752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:48.499215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] The token cache is being invalidate because project 405f11b9cc1c49ffab69d1497ee3f14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:48.499524 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.505929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-08046e7e-18a4-46bb-bf02-bea1b0909a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:48.508681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 969/1942] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:48 2022] DELETE /identity/v3/projects/405f11b9cc1c49ffab69d1497ee3f14b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:48.516129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25023-559a-49d9-8d95-0613f1b09ed9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.516454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25023-559a-49d9-8d95-0613f1b09ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.516773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25023-559a-49d9-8d95-0613f1b09ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.542711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-71d25023-559a-49d9-8d95-0613f1b09ed9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:48.544128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-71d25023-559a-49d9-8d95-0613f1b09ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:48.555230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 974/1943] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:48.556477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 970/1944] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:48.556608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454805ce-e577-4973-9aaf-a99aaaacd4ab None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.566236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43be9f6-735d-4416-ace3-c84fc4d4346a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.566978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43be9f6-735d-4416-ace3-c84fc4d4346a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.566978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43be9f6-735d-4416-ace3-c84fc4d4346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.586910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454805ce-e577-4973-9aaf-a99aaaacd4ab None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.606451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31956d-b03f-4643-add1-fea4e436860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.607139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31956d-b03f-4643-add1-fea4e436860c admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.607429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31956d-b03f-4643-add1-fea4e436860c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.607708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31956d-b03f-4643-add1-fea4e436860c admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.608601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31956d-b03f-4643-add1-fea4e436860c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:48.608912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31956d-b03f-4643-add1-fea4e436860c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:48.610542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31956d-b03f-4643-add1-fea4e436860c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:48.619407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c43be9f6-735d-4416-ace3-c84fc4d4346a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:48.623195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c43be9f6-735d-4416-ace3-c84fc4d4346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:48.641407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 975/1945] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:12:48.647938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 971/1946] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:48.650942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43be9f6-735d-4416-ace3-c84fc4d4346a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.654740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31956d-b03f-4643-add1-fea4e436860c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.663151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43be9f6-735d-4416-ace3-c84fc4d4346a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.670554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac647-666b-4fc9-a608-5e8e62843689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.671578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac647-666b-4fc9-a608-5e8e62843689 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.671930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac647-666b-4fc9-a608-5e8e62843689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.672156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac647-666b-4fc9-a608-5e8e62843689 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.673204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccac647-666b-4fc9-a608-5e8e62843689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:48.673518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccac647-666b-4fc9-a608-5e8e62843689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:48.676284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccac647-666b-4fc9-a608-5e8e62843689 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:48.680221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31956d-b03f-4643-add1-fea4e436860c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.686437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978f93f-dc03-44fd-a6e5-8b5136c08a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.687544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f93f-dc03-44fd-a6e5-8b5136c08a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.687824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f93f-dc03-44fd-a6e5-8b5136c08a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.688782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f93f-dc03-44fd-a6e5-8b5136c08a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.689653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978f93f-dc03-44fd-a6e5-8b5136c08a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:48.695354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978f93f-dc03-44fd-a6e5-8b5136c08a9b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:48.697457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 972/1947] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:48.702061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac647-666b-4fc9-a608-5e8e62843689 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.728935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac647-666b-4fc9-a608-5e8e62843689 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.737045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48657e7-42ac-402f-9695-5c7b0e2b4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.737794 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48657e7-42ac-402f-9695-5c7b0e2b4efd admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.738084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48657e7-42ac-402f-9695-5c7b0e2b4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.738647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48657e7-42ac-402f-9695-5c7b0e2b4efd admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.739110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48657e7-42ac-402f-9695-5c7b0e2b4efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:48.747172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48657e7-42ac-402f-9695-5c7b0e2b4efd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:48.750688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 976/1948] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:48 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:48.756798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978f93f-dc03-44fd-a6e5-8b5136c08a9b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.771466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:48.799553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 973/1949] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:48 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:48.800504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48657e7-42ac-402f-9695-5c7b0e2b4efd admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.865588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978f93f-dc03-44fd-a6e5-8b5136c08a9b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.928357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48657e7-42ac-402f-9695-5c7b0e2b4efd admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.933785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9f069-05b9-4a10-8dfe-7f0a07c31af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.934573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f069-05b9-4a10-8dfe-7f0a07c31af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.935375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f069-05b9-4a10-8dfe-7f0a07c31af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.935375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f069-05b9-4a10-8dfe-7f0a07c31af3 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.936089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9f069-05b9-4a10-8dfe-7f0a07c31af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:48.938410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9f069-05b9-4a10-8dfe-7f0a07c31af3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:48.942780 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a76893-1275-4fe3-bce6-8abf0402b3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.943723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a76893-1275-4fe3-bce6-8abf0402b3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.944208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a76893-1275-4fe3-bce6-8abf0402b3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.944421 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a76893-1275-4fe3-bce6-8abf0402b3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.945116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a76893-1275-4fe3-bce6-8abf0402b3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:48.948148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a76893-1275-4fe3-bce6-8abf0402b3e2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:48.969696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 974/1950] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:48 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:48.976886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9f069-05b9-4a10-8dfe-7f0a07c31af3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.982369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 977/1951] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:48 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:12:48.986928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a76893-1275-4fe3-bce6-8abf0402b3e2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:48.989220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9f069-05b9-4a10-8dfe-7f0a07c31af3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:48.995886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be62c0-f2de-4c11-abc0-ccdd2d3beb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:48.997482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be62c0-f2de-4c11-abc0-ccdd2d3beb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:48.997927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be62c0-f2de-4c11-abc0-ccdd2d3beb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:48.998412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be62c0-f2de-4c11-abc0-ccdd2d3beb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:48.999316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be62c0-f2de-4c11-abc0-ccdd2d3beb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.001199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be62c0-f2de-4c11-abc0-ccdd2d3beb8a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.002305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a76893-1275-4fe3-bce6-8abf0402b3e2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.009376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66029f97-b6e2-46f0-906b-161c93d7af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.010096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029f97-b6e2-46f0-906b-161c93d7af03 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.010393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029f97-b6e2-46f0-906b-161c93d7af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.010676 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029f97-b6e2-46f0-906b-161c93d7af03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.011592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66029f97-b6e2-46f0-906b-161c93d7af03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.013262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66029f97-b6e2-46f0-906b-161c93d7af03 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.017659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 975/1952] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:49.022561 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be62c0-f2de-4c11-abc0-ccdd2d3beb8a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.031562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 978/1953] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:49.032631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66029f97-b6e2-46f0-906b-161c93d7af03 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.035825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be62c0-f2de-4c11-abc0-ccdd2d3beb8a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.041687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e14e4-425e-4b5b-9c0e-dcb783ce9221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.042467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e14e4-425e-4b5b-9c0e-dcb783ce9221 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.042832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e14e4-425e-4b5b-9c0e-dcb783ce9221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.043192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e14e4-425e-4b5b-9c0e-dcb783ce9221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.043286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66029f97-b6e2-46f0-906b-161c93d7af03 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.044044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e14e4-425e-4b5b-9c0e-dcb783ce9221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.045729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e14e4-425e-4b5b-9c0e-dcb783ce9221 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.048182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c524e4-ea5c-4f15-a10d-a65cb7c1c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.048627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c524e4-ea5c-4f15-a10d-a65cb7c1c3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.049002 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c524e4-ea5c-4f15-a10d-a65cb7c1c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.049356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c524e4-ea5c-4f15-a10d-a65cb7c1c3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.050163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c524e4-ea5c-4f15-a10d-a65cb7c1c3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.052004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c524e4-ea5c-4f15-a10d-a65cb7c1c3fc admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.058897 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 976/1954] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:12:49.062912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e14e4-425e-4b5b-9c0e-dcb783ce9221 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.071249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 979/1955] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:49.076843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c524e4-ea5c-4f15-a10d-a65cb7c1c3fc admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.080974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e14e4-425e-4b5b-9c0e-dcb783ce9221 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.084519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:49.090625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c524e4-ea5c-4f15-a10d-a65cb7c1c3fc admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.091773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e1b4e-4f33-48ef-82a3-8f542f43f126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.093551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e1b4e-4f33-48ef-82a3-8f542f43f126 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.093551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e1b4e-4f33-48ef-82a3-8f542f43f126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.093936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e1b4e-4f33-48ef-82a3-8f542f43f126 admin admin] PATH_INFO: `/v3/projects/c481a73089a4432a81302c8386fa7e65/users/c29c8af06ad843a9bc7a74633df8653d/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.100926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f43b22-1f15-4e20-a188-408a96e4ccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.101543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f43b22-1f15-4e20-a188-408a96e4ccaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.104262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f43b22-1f15-4e20-a188-408a96e4ccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.104988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f43b22-1f15-4e20-a188-408a96e4ccaa admin admin] PATH_INFO: `/v3/projects/c8440789da1f43bc83cc9fb9a722fda1/users/42b6fef5e4c8449286482df538f94d58/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.122577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e1b4e-4f33-48ef-82a3-8f542f43f126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c481a73089a4432a81302c8386fa7e65, user_id=c29c8af06ad843a9bc7a74633df8653d, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.125867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e1b4e-4f33-48ef-82a3-8f542f43f126 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.135435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f43b22-1f15-4e20-a188-408a96e4ccaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8440789da1f43bc83cc9fb9a722fda1, user_id=42b6fef5e4c8449286482df538f94d58, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.138915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f43b22-1f15-4e20-a188-408a96e4ccaa admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.145655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 977/1956] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:49 2022] PUT /identity/v3/projects/c481a73089a4432a81302c8386fa7e65/users/c29c8af06ad843a9bc7a74633df8653d/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:49.156352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7368f-ee30-42a9-83fb-d3d71412a1cc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.156791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7368f-ee30-42a9-83fb-d3d71412a1cc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.157274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7368f-ee30-42a9-83fb-d3d71412a1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.186415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 980/1957] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:49 2022] PUT /identity/v3/projects/c8440789da1f43bc83cc9fb9a722fda1/users/42b6fef5e4c8449286482df538f94d58/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:49.196788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f3c8e-da8f-4e52-b85d-f3e6591397d9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.197156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f3c8e-da8f-4e52-b85d-f3e6591397d9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.197579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f3c8e-da8f-4e52-b85d-f3e6591397d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.238822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-44e7368f-ee30-42a9-83fb-d3d71412a1cc None None] MFA Rules not processed for user `c29c8af06ad843a9bc7a74633df8653d`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:49.250182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-44e7368f-ee30-42a9-83fb-d3d71412a1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:49.269964 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-732f3c8e-da8f-4e52-b85d-f3e6591397d9 None None] MFA Rules not processed for user `42b6fef5e4c8449286482df538f94d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:49.272702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-732f3c8e-da8f-4e52-b85d-f3e6591397d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:49.370113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 981/1958] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:49.373740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f3c8e-da8f-4e52-b85d-f3e6591397d9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.414226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 978/1959] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:12:49.429367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7368f-ee30-42a9-83fb-d3d71412a1cc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.431199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-44e7368f-ee30-42a9-83fb-d3d71412a1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:49.464583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f3c8e-da8f-4e52-b85d-f3e6591397d9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.471275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bb372-7a86-4bdd-9b7a-9a4f7f6964ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.471962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bb372-7a86-4bdd-9b7a-9a4f7f6964ac admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.472254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bb372-7a86-4bdd-9b7a-9a4f7f6964ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.472533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bb372-7a86-4bdd-9b7a-9a4f7f6964ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.473231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bb372-7a86-4bdd-9b7a-9a4f7f6964ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.476244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bb372-7a86-4bdd-9b7a-9a4f7f6964ac admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.489743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:49.515950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 982/1960] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:49 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:12:49.520248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bb372-7a86-4bdd-9b7a-9a4f7f6964ac admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.543330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7368f-ee30-42a9-83fb-d3d71412a1cc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.612213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:49.635831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bb372-7a86-4bdd-9b7a-9a4f7f6964ac admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.648175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe8cb9-de28-42c3-b36c-fbe9c68d2c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.648872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe8cb9-de28-42c3-b36c-fbe9c68d2c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.649810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe8cb9-de28-42c3-b36c-fbe9c68d2c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.649810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe8cb9-de28-42c3-b36c-fbe9c68d2c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.650915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe8cb9-de28-42c3-b36c-fbe9c68d2c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.664045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d5d11-b97a-4ae8-951b-62c7838314a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.664045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d5d11-b97a-4ae8-951b-62c7838314a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.664045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d5d11-b97a-4ae8-951b-62c7838314a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.664045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d5d11-b97a-4ae8-951b-62c7838314a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.664831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe8cb9-de28-42c3-b36c-fbe9c68d2c49 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.723436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 983/1961] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:49 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:49.726118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe837-4c0e-4f11-adba-721eb7186beb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.726413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe837-4c0e-4f11-adba-721eb7186beb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.726757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe837-4c0e-4f11-adba-721eb7186beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.762479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-fe3fe837-4c0e-4f11-adba-721eb7186beb None None] MFA Rules not processed for user `9180a2ba34ec4d659d4ff3da263408d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:49.764083 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fe3fe837-4c0e-4f11-adba-721eb7186beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:49.800175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d5d11-b97a-4ae8-951b-62c7838314a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.803542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d5d11-b97a-4ae8-951b-62c7838314a6 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.832736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 979/1962] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:49.854815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d5d11-b97a-4ae8-951b-62c7838314a6 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.893778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d5d11-b97a-4ae8-951b-62c7838314a6 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.907235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797baedd-836f-4e95-9e9a-259e0659ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.907954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797baedd-836f-4e95-9e9a-259e0659ae39 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.908247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797baedd-836f-4e95-9e9a-259e0659ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.908525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797baedd-836f-4e95-9e9a-259e0659ae39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.909266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797baedd-836f-4e95-9e9a-259e0659ae39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.915737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797baedd-836f-4e95-9e9a-259e0659ae39 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.946503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 980/1963] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:49.949500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797baedd-836f-4e95-9e9a-259e0659ae39 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.964791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797baedd-836f-4e95-9e9a-259e0659ae39 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:49.969912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ad3f0-f5bc-4e55-a2e7-bfb01ef2b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:49.970657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ad3f0-f5bc-4e55-a2e7-bfb01ef2b152 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:49.970957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ad3f0-f5bc-4e55-a2e7-bfb01ef2b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:49.971243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ad3f0-f5bc-4e55-a2e7-bfb01ef2b152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:49.972099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ad3f0-f5bc-4e55-a2e7-bfb01ef2b152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:49.973769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ad3f0-f5bc-4e55-a2e7-bfb01ef2b152 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:49.992727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 981/1964] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:49.993656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ad3f0-f5bc-4e55-a2e7-bfb01ef2b152 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:49.995585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 984/1965] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:50.006377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ad3f0-f5bc-4e55-a2e7-bfb01ef2b152 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:50.012850 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e5451-3b5a-4a03-86b3-77c12d5615a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:50.014406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1046-f8a0-48ac-9c5f-af73d3dfff75 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.014628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e5451-3b5a-4a03-86b3-77c12d5615a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.014843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1046-f8a0-48ac-9c5f-af73d3dfff75 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.014962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e5451-3b5a-4a03-86b3-77c12d5615a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.015368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1046-f8a0-48ac-9c5f-af73d3dfff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.015501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e5451-3b5a-4a03-86b3-77c12d5615a4 admin admin] PATH_INFO: `/v3/projects/4a5b7c84724c4717ba0fa205c0225f6f/users/c7ca47fa4da548c6be9bf9947427a50e/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.051487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e5451-3b5a-4a03-86b3-77c12d5615a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5b7c84724c4717ba0fa205c0225f6f, user_id=c7ca47fa4da548c6be9bf9947427a50e, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:50.058951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d2ea1046-f8a0-48ac-9c5f-af73d3dfff75 None None] MFA Rules not processed for user `d35e17f0fecd43fe900860ad108d8e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:50.059702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e5451-3b5a-4a03-86b3-77c12d5615a4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:50.061155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d2ea1046-f8a0-48ac-9c5f-af73d3dfff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:50.101208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 982/1966] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:49 2022] PUT /identity/v3/projects/4a5b7c84724c4717ba0fa205c0225f6f/users/c7ca47fa4da548c6be9bf9947427a50e/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:50.103173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae86710-802a-493e-85e0-308edcffc27a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.103480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae86710-802a-493e-85e0-308edcffc27a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.103768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae86710-802a-493e-85e0-308edcffc27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.162735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5ae86710-802a-493e-85e0-308edcffc27a None None] MFA Rules not processed for user `c7ca47fa4da548c6be9bf9947427a50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:50.164595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5ae86710-802a-493e-85e0-308edcffc27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:50.220115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 985/1967] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:50.262758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1046-f8a0-48ac-9c5f-af73d3dfff75 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:50.264326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d2ea1046-f8a0-48ac-9c5f-af73d3dfff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:50.265810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:50.306083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 983/1968] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:50.310846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae86710-802a-493e-85e0-308edcffc27a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:50.361903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1046-f8a0-48ac-9c5f-af73d3dfff75 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:50.383149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:50.398315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae86710-802a-493e-85e0-308edcffc27a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:50.405243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b3db-113b-4e09-b0d5-97a83c25daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:50.406752 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b3db-113b-4e09-b0d5-97a83c25daef admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.407378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b3db-113b-4e09-b0d5-97a83c25daef admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.407703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b3db-113b-4e09-b0d5-97a83c25daef admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.408542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b3db-113b-4e09-b0d5-97a83c25daef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:50.410805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b3db-113b-4e09-b0d5-97a83c25daef admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:50.454764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 984/1969] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:50 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:12:50.459995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b3db-113b-4e09-b0d5-97a83c25daef admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:50.462135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53838860-4eca-47ec-afe3-86d5b38a49b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:50.462833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53838860-4eca-47ec-afe3-86d5b38a49b8 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.463115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53838860-4eca-47ec-afe3-86d5b38a49b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.463395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53838860-4eca-47ec-afe3-86d5b38a49b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.465195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-53838860-4eca-47ec-afe3-86d5b38a49b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:50.551667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53838860-4eca-47ec-afe3-86d5b38a49b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:50.553471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53838860-4eca-47ec-afe3-86d5b38a49b8 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:50.567999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 986/1970] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:50.569589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b3db-113b-4e09-b0d5-97a83c25daef admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:50.574899 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ac600-9db2-4688-8e65-1fc9b1cc9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:50.575585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac600-9db2-4688-8e65-1fc9b1cc9554 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.575868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac600-9db2-4688-8e65-1fc9b1cc9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.576172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac600-9db2-4688-8e65-1fc9b1cc9554 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.576869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ac600-9db2-4688-8e65-1fc9b1cc9554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:50.578951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ac600-9db2-4688-8e65-1fc9b1cc9554 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:50.613185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53838860-4eca-47ec-afe3-86d5b38a49b8 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:50.616562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 985/1971] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:50 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:50.624760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53838860-4eca-47ec-afe3-86d5b38a49b8 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:50.631476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43983c-cffc-462e-ad63-73f79f73148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:50.632192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43983c-cffc-462e-ad63-73f79f73148a admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.632608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43983c-cffc-462e-ad63-73f79f73148a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.633066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43983c-cffc-462e-ad63-73f79f73148a admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.633928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43983c-cffc-462e-ad63-73f79f73148a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:50.635539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43983c-cffc-462e-ad63-73f79f73148a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:50.649586 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 987/1972] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:12:50.652785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ac600-9db2-4688-8e65-1fc9b1cc9554 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:50.665008 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ac600-9db2-4688-8e65-1fc9b1cc9554 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:50.674488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e31814-adec-4353-8be9-83c24136e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:50.675424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e31814-adec-4353-8be9-83c24136e9da admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.675845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e31814-adec-4353-8be9-83c24136e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.676161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e31814-adec-4353-8be9-83c24136e9da admin admin] PATH_INFO: `/v3/projects/97c39474f2d142fea56f30c146cf8dc2/users/db06a0185bd7411d985c4a390bcb42ed/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.694032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e31814-adec-4353-8be9-83c24136e9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c39474f2d142fea56f30c146cf8dc2, user_id=db06a0185bd7411d985c4a390bcb42ed, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:50.696779 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e31814-adec-4353-8be9-83c24136e9da admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:50.713755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 986/1973] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:50 2022] PUT /identity/v3/projects/97c39474f2d142fea56f30c146cf8dc2/users/db06a0185bd7411d985c4a390bcb42ed/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:50.717893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43983c-cffc-462e-ad63-73f79f73148a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:50.734168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43983c-cffc-462e-ad63-73f79f73148a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:50.800497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaccaf-e07d-486a-9230-fecec5216839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:50.801186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaccaf-e07d-486a-9230-fecec5216839 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.802515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaccaf-e07d-486a-9230-fecec5216839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.802808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaccaf-e07d-486a-9230-fecec5216839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.803823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaccaf-e07d-486a-9230-fecec5216839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:50.805505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaccaf-e07d-486a-9230-fecec5216839 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:50.816972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 988/1974] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:12:50.821936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e31814-adec-4353-8be9-83c24136e9da admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:50.834629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e31814-adec-4353-8be9-83c24136e9da admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:50.840359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d2d8-f353-4bf8-8e85-60e3e205455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:50.841971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d2d8-f353-4bf8-8e85-60e3e205455a admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.842432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d2d8-f353-4bf8-8e85-60e3e205455a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.843039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d2d8-f353-4bf8-8e85-60e3e205455a admin admin] PATH_INFO: `/v3/projects/97c39474f2d142fea56f30c146cf8dc2/users/db06a0185bd7411d985c4a390bcb42ed/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.846189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39d2d8-f353-4bf8-8e85-60e3e205455a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c39474f2d142fea56f30c146cf8dc2, user_id=db06a0185bd7411d985c4a390bcb42ed, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:50.850477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39d2d8-f353-4bf8-8e85-60e3e205455a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:50.863813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 987/1975] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:50 2022] PUT /identity/v3/projects/97c39474f2d142fea56f30c146cf8dc2/users/db06a0185bd7411d985c4a390bcb42ed/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:50.876721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafe2cd-5f06-48da-b585-3f153692ae8a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:50.877095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafe2cd-5f06-48da-b585-3f153692ae8a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:50.877453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafe2cd-5f06-48da-b585-3f153692ae8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:50.905083 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1eafe2cd-5f06-48da-b585-3f153692ae8a None None] MFA Rules not processed for user `db06a0185bd7411d985c4a390bcb42ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:50.906417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1eafe2cd-5f06-48da-b585-3f153692ae8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:50.934890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:51.003046 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 989/1976] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:51.016864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d2d8-f353-4bf8-8e85-60e3e205455a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:51.053095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:51.097982 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d2d8-f353-4bf8-8e85-60e3e205455a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:51.107704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d32b5-9fb0-404e-af8c-c52c63bb1d9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:51.108338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d32b5-9fb0-404e-af8c-c52c63bb1d9f service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:51.108631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d32b5-9fb0-404e-af8c-c52c63bb1d9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:51.108916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d32b5-9fb0-404e-af8c-c52c63bb1d9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:51.122074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d32b5-9fb0-404e-af8c-c52c63bb1d9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:51.123607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d32b5-9fb0-404e-af8c-c52c63bb1d9f service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:51.134039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 988/1977] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:51.177815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafe2cd-5f06-48da-b585-3f153692ae8a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:51.190881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafe2cd-5f06-48da-b585-3f153692ae8a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:51.196199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c7aae-cd7c-4372-bcf6-08f8c3ad52a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:51.197115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c7aae-cd7c-4372-bcf6-08f8c3ad52a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:51.197507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c7aae-cd7c-4372-bcf6-08f8c3ad52a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:51.197919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c7aae-cd7c-4372-bcf6-08f8c3ad52a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:51.284960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c7aae-cd7c-4372-bcf6-08f8c3ad52a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:51.288175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c7aae-cd7c-4372-bcf6-08f8c3ad52a9 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:51.303098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 990/1978] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:53.231942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d32b5-9fb0-404e-af8c-c52c63bb1d9f service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:53.414597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d32b5-9fb0-404e-af8c-c52c63bb1d9f service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:53.420306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:53.421569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:53.421853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:53.422135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] PATH_INFO: `/v3/users/c29c8af06ad843a9bc7a74633df8653d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:53.423646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29c8af06ad843a9bc7a74633df8653d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:53.425700 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:53.493888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29c8af06ad843a9bc7a74633df8653d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:53.522122 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29c8af06ad843a9bc7a74633df8653d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:53.522798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29c8af06ad843a9bc7a74633df8653d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:53.558514 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29c8af06ad843a9bc7a74633df8653d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:53.560622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29c8af06ad843a9bc7a74633df8653d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:53.580211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 989/1979] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:53 2022] DELETE /identity/v3/users/c29c8af06ad843a9bc7a74633df8653d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:53.587215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238b9c8-bddf-4b21-9f85-af3ecd8e61d0 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:53.591233 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238b9c8-bddf-4b21-9f85-af3ecd8e61d0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:53.592410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238b9c8-bddf-4b21-9f85-af3ecd8e61d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:53.629270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a238b9c8-bddf-4b21-9f85-af3ecd8e61d0 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:53.630566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a238b9c8-bddf-4b21-9f85-af3ecd8e61d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:53.695566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 991/1980] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:53.710240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:53.712214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:53.759693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:53.780579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c404f55-7040-4d79-bc41-a4649d159ab9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:53.784655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcfcc6-7e48-4abc-aeb0-15f6962144fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:53.785325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcfcc6-7e48-4abc-aeb0-15f6962144fa service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:53.785619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcfcc6-7e48-4abc-aeb0-15f6962144fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:53.786007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcfcc6-7e48-4abc-aeb0-15f6962144fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:53.798286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcfcc6-7e48-4abc-aeb0-15f6962144fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:53.799721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcfcc6-7e48-4abc-aeb0-15f6962144fa service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:53.813299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 990/1981] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:54.218441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238b9c8-bddf-4b21-9f85-af3ecd8e61d0 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:54.220042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a238b9c8-bddf-4b21-9f85-af3ecd8e61d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:54.238652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238b9c8-bddf-4b21-9f85-af3ecd8e61d0 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:54.244117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:54.244995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.245280 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.245558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] PATH_INFO: `/v3/projects/c481a73089a4432a81302c8386fa7e65` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.246798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c481a73089a4432a81302c8386fa7e65)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:54.249220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:54.304172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c481a73089a4432a81302c8386fa7e65', 'request_id': 'req-00191d32-4aaa-4faa-a638-dbe52377cf71'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:54.305934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:54.310361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c481a73089a4432a81302c8386fa7e65', 'request_id': 'req-00191d32-4aaa-4faa-a638-dbe52377cf71'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:54.320605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c481a73089a4432a81302c8386fa7e65', 'request_id': 'req-00191d32-4aaa-4faa-a638-dbe52377cf71'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:54.331928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] The token cache is being invalidate because project c481a73089a4432a81302c8386fa7e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:54.332221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:54.333451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-00191d32-4aaa-4faa-a638-dbe52377cf71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:54.335128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 992/1982] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:54 2022] DELETE /identity/v3/projects/c481a73089a4432a81302c8386fa7e65 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:54.340770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b2e5e-d640-4719-b041-c540a3618597 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.341268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b2e5e-d640-4719-b041-c540a3618597 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.341384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b2e5e-d640-4719-b041-c540a3618597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.360843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d49b2e5e-d640-4719-b041-c540a3618597 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:54.362045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d49b2e5e-d640-4719-b041-c540a3618597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:54.428654 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 991/1983] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:54.437562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8c762-8b56-4bc4-a9c4-45a564cfc765 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.437562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8c762-8b56-4bc4-a9c4-45a564cfc765 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.437562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8c762-8b56-4bc4-a9c4-45a564cfc765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.459736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1ff8c762-8b56-4bc4-a9c4-45a564cfc765 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:54.461350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1ff8c762-8b56-4bc4-a9c4-45a564cfc765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:54.470171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 993/1984] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:54.475128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b2e5e-d640-4719-b041-c540a3618597 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:54.487374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b2e5e-d640-4719-b041-c540a3618597 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:54.503366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35fec-ee06-4966-8039-8f47c57dd617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:54.504090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35fec-ee06-4966-8039-8f47c57dd617 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.504488 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35fec-ee06-4966-8039-8f47c57dd617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.504704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35fec-ee06-4966-8039-8f47c57dd617 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.505459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b35fec-ee06-4966-8039-8f47c57dd617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:12:54.505831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b35fec-ee06-4966-8039-8f47c57dd617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:54.507478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b35fec-ee06-4966-8039-8f47c57dd617 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:54.521481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 992/1985] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:12:54.525764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8c762-8b56-4bc4-a9c4-45a564cfc765 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:54.535475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8c762-8b56-4bc4-a9c4-45a564cfc765 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:54.540622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a6949-0cdd-46d2-a2c9-0d5f7b2c8c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:54.541325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a6949-0cdd-46d2-a2c9-0d5f7b2c8c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.541614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a6949-0cdd-46d2-a2c9-0d5f7b2c8c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.541894 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a6949-0cdd-46d2-a2c9-0d5f7b2c8c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.542643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a6949-0cdd-46d2-a2c9-0d5f7b2c8c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:54.544634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a6949-0cdd-46d2-a2c9-0d5f7b2c8c93 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:54.575232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 994/1986] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:12:54 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:54.576423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35fec-ee06-4966-8039-8f47c57dd617 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:54.587477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35fec-ee06-4966-8039-8f47c57dd617 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:54.657576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beefdcd-08b1-4fd4-91e8-3baa4ed8b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:54.658259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beefdcd-08b1-4fd4-91e8-3baa4ed8b171 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.658550 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beefdcd-08b1-4fd4-91e8-3baa4ed8b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.659111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beefdcd-08b1-4fd4-91e8-3baa4ed8b171 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.659831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beefdcd-08b1-4fd4-91e8-3baa4ed8b171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:54.662672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beefdcd-08b1-4fd4-91e8-3baa4ed8b171 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:54.687641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 993/1987] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:12:54 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:12:54.692778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a6949-0cdd-46d2-a2c9-0d5f7b2c8c93 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:54.704672 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a6949-0cdd-46d2-a2c9-0d5f7b2c8c93 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:54.710164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc66d-40e6-41ca-980c-314e07660d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:54.710907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc66d-40e6-41ca-980c-314e07660d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.711519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc66d-40e6-41ca-980c-314e07660d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.711519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc66d-40e6-41ca-980c-314e07660d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.712240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bc66d-40e6-41ca-980c-314e07660d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:54.715296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bc66d-40e6-41ca-980c-314e07660d4e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:54.728277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 995/1988] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:54.732332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beefdcd-08b1-4fd4-91e8-3baa4ed8b171 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:54.743640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beefdcd-08b1-4fd4-91e8-3baa4ed8b171 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:54.749665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638844e-0b10-4446-be62-93ec3dd8f90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:54.750415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638844e-0b10-4446-be62-93ec3dd8f90e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.750625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638844e-0b10-4446-be62-93ec3dd8f90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.750981 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638844e-0b10-4446-be62-93ec3dd8f90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.752039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638844e-0b10-4446-be62-93ec3dd8f90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:54.753703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638844e-0b10-4446-be62-93ec3dd8f90e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:54.767922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 994/1989] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:12:54.769135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc66d-40e6-41ca-980c-314e07660d4e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:54.790264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc66d-40e6-41ca-980c-314e07660d4e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:54.800441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d814e-b064-4a55-95f1-f5f8418d1a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:54.801761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d814e-b064-4a55-95f1-f5f8418d1a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.802203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d814e-b064-4a55-95f1-f5f8418d1a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.803108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d814e-b064-4a55-95f1-f5f8418d1a33 admin admin] PATH_INFO: `/v3/projects/14805311b4114b789a1d518f9dc4c491/users/c71e317587f6475790af1cc766215358/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.834176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d814e-b064-4a55-95f1-f5f8418d1a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14805311b4114b789a1d518f9dc4c491, user_id=c71e317587f6475790af1cc766215358, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:54.838908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d814e-b064-4a55-95f1-f5f8418d1a33 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:54.850110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638844e-0b10-4446-be62-93ec3dd8f90e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:54.852144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2638844e-0b10-4446-be62-93ec3dd8f90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:54.859387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 996/1990] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:12:54 2022] PUT /identity/v3/projects/14805311b4114b789a1d518f9dc4c491/users/c71e317587f6475790af1cc766215358/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:54.864822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1db99e-d2df-4fcd-b0d8-2d06f0955fbb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:54.865293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1db99e-d2df-4fcd-b0d8-2d06f0955fbb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:54.865650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1db99e-d2df-4fcd-b0d8-2d06f0955fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:54.875625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638844e-0b10-4446-be62-93ec3dd8f90e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:54.893488 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ec1db99e-d2df-4fcd-b0d8-2d06f0955fbb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:54.894950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec1db99e-d2df-4fcd-b0d8-2d06f0955fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:54.987430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:54.998809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 997/1991] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:55.004217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:55.006070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:55.006466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:55.006902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] PATH_INFO: `/v3/users/42b6fef5e4c8449286482df538f94d58` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:55.010569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b6fef5e4c8449286482df538f94d58)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:55.012772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:55.059001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1db99e-d2df-4fcd-b0d8-2d06f0955fbb None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:55.060904 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec1db99e-d2df-4fcd-b0d8-2d06f0955fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:55.107952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b6fef5e4c8449286482df538f94d58'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:55.124818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b6fef5e4c8449286482df538f94d58'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:55.125583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b6fef5e4c8449286482df538f94d58'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:55.141634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b6fef5e4c8449286482df538f94d58'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:55.142678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a4c45adf-faaf-45e6-b05f-9426b5f2aa9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b6fef5e4c8449286482df538f94d58'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:55.158296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 995/1992] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:54 2022] DELETE /identity/v3/users/42b6fef5e4c8449286482df538f94d58 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:55.162532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf2a5-b11d-4182-b6b1-d0042393feb0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:55.162817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf2a5-b11d-4182-b6b1-d0042393feb0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:55.163104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf2a5-b11d-4182-b6b1-d0042393feb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:55.164337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1db99e-d2df-4fcd-b0d8-2d06f0955fbb None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:55.184490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-11cdf2a5-b11d-4182-b6b1-d0042393feb0 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:55.187308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-11cdf2a5-b11d-4182-b6b1-d0042393feb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:55.207259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:55.236557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:55.237229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:55.237636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:55.237917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:55.251254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:55.284040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 996/1993] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:55.365201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf2a5-b11d-4182-b6b1-d0042393feb0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:55.369625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-11cdf2a5-b11d-4182-b6b1-d0042393feb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:55.397815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:55.399482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:55.399639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf2a5-b11d-4182-b6b1-d0042393feb0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:55.410693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba24845-80ea-4b74-bd9f-766b05e967f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:55.412991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 998/1994] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:55.414961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba24845-80ea-4b74-bd9f-766b05e967f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:55.415588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba24845-80ea-4b74-bd9f-766b05e967f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:55.415891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba24845-80ea-4b74-bd9f-766b05e967f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:55.431366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba24845-80ea-4b74-bd9f-766b05e967f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:55.433110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba24845-80ea-4b74-bd9f-766b05e967f7 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:55.447423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 997/1995] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:12:56.743448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:56.745953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:56.764118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514c0bd-4adf-485f-ad2c-0e8b555f6041 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:56.785568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:56.788002 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:56.788597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:56.789149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] PATH_INFO: `/v3/projects/c8440789da1f43bc83cc9fb9a722fda1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:56.792461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8440789da1f43bc83cc9fb9a722fda1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:56.797221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:56.919399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8440789da1f43bc83cc9fb9a722fda1', 'request_id': 'req-f907b566-4565-4f48-b053-fb7512d74096'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:56.941953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8440789da1f43bc83cc9fb9a722fda1', 'request_id': 'req-f907b566-4565-4f48-b053-fb7512d74096'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:56.955598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8440789da1f43bc83cc9fb9a722fda1', 'request_id': 'req-f907b566-4565-4f48-b053-fb7512d74096'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:56.976316 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] The token cache is being invalidate because project c8440789da1f43bc83cc9fb9a722fda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:56.976619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:56.977875 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:56.983476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 999/1996] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:56 2022] DELETE /identity/v3/projects/c8440789da1f43bc83cc9fb9a722fda1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:56.984910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba24845-80ea-4b74-bd9f-766b05e967f7 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:56.999723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba24845-80ea-4b74-bd9f-766b05e967f7 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:57.076786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:57.085776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:57.086678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:57.086961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:57.087233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] PATH_INFO: `/v3/users/c7ca47fa4da548c6be9bf9947427a50e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:57.089042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ca47fa4da548c6be9bf9947427a50e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:57.091381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:57.185748 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ca47fa4da548c6be9bf9947427a50e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:57.204555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ca47fa4da548c6be9bf9947427a50e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:57.205210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ca47fa4da548c6be9bf9947427a50e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:57.231540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ca47fa4da548c6be9bf9947427a50e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:57.232852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7a6300a9-7e01-4cb4-acc5-6cb27f4ebaad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ca47fa4da548c6be9bf9947427a50e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:57.264497 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 998/1997] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:56 2022] DELETE /identity/v3/users/c7ca47fa4da548c6be9bf9947427a50e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:57.836175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:57.839169 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:57.891579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907b566-4565-4f48-b053-fb7512d74096 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:58.055212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:58.056828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:58.057328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:58.057810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] PATH_INFO: `/v3/users/b228a87c58684789b75e67615a26bbc3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:58.061724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b228a87c58684789b75e67615a26bbc3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:58.064118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:58.076735 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:58.195035 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b228a87c58684789b75e67615a26bbc3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.214959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b228a87c58684789b75e67615a26bbc3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.238747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b228a87c58684789b75e67615a26bbc3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.240039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b228a87c58684789b75e67615a26bbc3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.240840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b228a87c58684789b75e67615a26bbc3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.258708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1000/1998] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:57 2022] DELETE /identity/v3/users/b228a87c58684789b75e67615a26bbc3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:58.263219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05973d-596d-4069-8b9d-af15c20953d3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:58.263754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05973d-596d-4069-8b9d-af15c20953d3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:58.264266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05973d-596d-4069-8b9d-af15c20953d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:58.289379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0b05973d-596d-4069-8b9d-af15c20953d3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:12:58.290932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0b05973d-596d-4069-8b9d-af15c20953d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:58.391167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 999/1999] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:12:58.419773 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:58.421922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:58.533482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd1324-3f60-40b2-8c8d-9373ffe697df admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:58.539196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf4eff-db7b-477f-b7e0-4f49c04bf71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:58.539880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf4eff-db7b-477f-b7e0-4f49c04bf71e service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:58.540202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf4eff-db7b-477f-b7e0-4f49c04bf71e service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:58.540519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf4eff-db7b-477f-b7e0-4f49c04bf71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:58.555829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf4eff-db7b-477f-b7e0-4f49c04bf71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:58.557722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf4eff-db7b-477f-b7e0-4f49c04bf71e service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:58.571854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1001/2000] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:12:58.651491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05973d-596d-4069-8b9d-af15c20953d3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:58.655795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0b05973d-596d-4069-8b9d-af15c20953d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:12:58.684846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05973d-596d-4069-8b9d-af15c20953d3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:58.694484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:58.696419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:58.696419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:58.696419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] PATH_INFO: `/v3/projects/4a5b7c84724c4717ba0fa205c0225f6f` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:58.698660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5b7c84724c4717ba0fa205c0225f6f)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:58.701103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:58.844405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5b7c84724c4717ba0fa205c0225f6f', 'request_id': 'req-64a318cb-2d89-400f-9feb-53894f338a68'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.853883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5b7c84724c4717ba0fa205c0225f6f', 'request_id': 'req-64a318cb-2d89-400f-9feb-53894f338a68'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.864916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5b7c84724c4717ba0fa205c0225f6f', 'request_id': 'req-64a318cb-2d89-400f-9feb-53894f338a68'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.884566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:58.894889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] The token cache is being invalidate because project 4a5b7c84724c4717ba0fa205c0225f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:12:58.896607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.898084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:58.901407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1000/2001] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:12:58 2022] DELETE /identity/v3/projects/4a5b7c84724c4717ba0fa205c0225f6f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:12:58.905524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf4eff-db7b-477f-b7e0-4f49c04bf71e service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:12:58.920927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf4eff-db7b-477f-b7e0-4f49c04bf71e service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:12:59.060642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:12:59.061816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:12:59.064999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:12:59.065630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] PATH_INFO: `/v3/users/db06a0185bd7411d985c4a390bcb42ed` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:12:59.067641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db06a0185bd7411d985c4a390bcb42ed)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:12:59.070093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:12:59.186755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:12:59.226437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db06a0185bd7411d985c4a390bcb42ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:59.252732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db06a0185bd7411d985c4a390bcb42ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:59.281346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db06a0185bd7411d985c4a390bcb42ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:59.282245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db06a0185bd7411d985c4a390bcb42ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:59.283739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db06a0185bd7411d985c4a390bcb42ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:12:59.312064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1002/2002] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:12:58 2022] DELETE /identity/v3/users/db06a0185bd7411d985c4a390bcb42ed => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:00.230030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:00.232499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:00.255814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a318cb-2d89-400f-9feb-53894f338a68 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:00.376601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:00.377492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:00.377774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:00.378053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] PATH_INFO: `/v3/projects/54e383d83d45400a9aec057396b97984` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:00.381619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e383d83d45400a9aec057396b97984)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:00.383434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:00.487927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e383d83d45400a9aec057396b97984', 'request_id': 'req-26908426-4b9c-4b33-b193-4df3e81c89c9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.495224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e383d83d45400a9aec057396b97984', 'request_id': 'req-26908426-4b9c-4b33-b193-4df3e81c89c9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.504211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e383d83d45400a9aec057396b97984', 'request_id': 'req-26908426-4b9c-4b33-b193-4df3e81c89c9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.525600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] The token cache is being invalidate because project 54e383d83d45400a9aec057396b97984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:00.525600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.525907 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.528085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1001/2003] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:00 2022] DELETE /identity/v3/projects/54e383d83d45400a9aec057396b97984 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:00.531853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:00.535227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:00.549767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00330-5362-43c2-8518-decb2ce4093d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:00.684605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:00.685598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:00.685944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:00.686290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] PATH_INFO: `/v3/users/46d06b8197d84141b55755f74be8cc25` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:00.688699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d06b8197d84141b55755f74be8cc25)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:00.691199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:00.789409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d06b8197d84141b55755f74be8cc25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.808399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d06b8197d84141b55755f74be8cc25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.823926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d06b8197d84141b55755f74be8cc25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.825745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d06b8197d84141b55755f74be8cc25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.826883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-22b4fae6-cf16-4d88-b283-a02b99d4e7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d06b8197d84141b55755f74be8cc25'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:00.855048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1003/2004] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:00 2022] DELETE /identity/v3/users/46d06b8197d84141b55755f74be8cc25 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:01.001997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:01.003642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:01.026714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908426-4b9c-4b33-b193-4df3e81c89c9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:01.190180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:01.191332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:01.191630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:01.192031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] PATH_INFO: `/v3/projects/97c39474f2d142fea56f30c146cf8dc2` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:01.195834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c39474f2d142fea56f30c146cf8dc2)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:01.199835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:01.310246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:01.372426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c39474f2d142fea56f30c146cf8dc2', 'request_id': 'req-ca04ea94-00dc-4daf-9947-52b991228e4b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.389218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c39474f2d142fea56f30c146cf8dc2', 'request_id': 'req-ca04ea94-00dc-4daf-9947-52b991228e4b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.406977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c39474f2d142fea56f30c146cf8dc2', 'request_id': 'req-ca04ea94-00dc-4daf-9947-52b991228e4b'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.435786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] The token cache is being invalidate because project 97c39474f2d142fea56f30c146cf8dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:01.436224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.437608 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.442997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1002/2005] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:01 2022] DELETE /identity/v3/projects/97c39474f2d142fea56f30c146cf8dc2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:01.448980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe222e-1ee0-47c3-b7a5-890d0cdd9fb4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:01.449396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe222e-1ee0-47c3-b7a5-890d0cdd9fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:01.449690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe222e-1ee0-47c3-b7a5-890d0cdd9fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:01.475893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8efe222e-1ee0-47c3-b7a5-890d0cdd9fb4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:01.477547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8efe222e-1ee0-47c3-b7a5-890d0cdd9fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:01.506859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:01.524250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:01.526059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:01.597937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1004/2006] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:01.606941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013bf86-cd17-4b7d-a29f-4c46383ba7b2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:01.607572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013bf86-cd17-4b7d-a29f-4c46383ba7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:01.608108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013bf86-cd17-4b7d-a29f-4c46383ba7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:01.647320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7013bf86-cd17-4b7d-a29f-4c46383ba7b2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:01.649051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7013bf86-cd17-4b7d-a29f-4c46383ba7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:01.660156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ea94-00dc-4daf-9947-52b991228e4b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:01.671397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1005/2007] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:01.671977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:01.673566 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:01.674015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:01.674444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] PATH_INFO: `/v3/projects/fb06e5ae3dff4180a80bb90833206263` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:01.675379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013bf86-cd17-4b7d-a29f-4c46383ba7b2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:01.677409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb06e5ae3dff4180a80bb90833206263)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:01.679535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:01.698286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013bf86-cd17-4b7d-a29f-4c46383ba7b2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:01.706765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac76e2c-c5f0-43a6-96de-1b7cb57134e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:01.708314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac76e2c-c5f0-43a6-96de-1b7cb57134e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:01.709260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac76e2c-c5f0-43a6-96de-1b7cb57134e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:01.709260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac76e2c-c5f0-43a6-96de-1b7cb57134e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:01.712754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac76e2c-c5f0-43a6-96de-1b7cb57134e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:01.713214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac76e2c-c5f0-43a6-96de-1b7cb57134e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:01.714991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac76e2c-c5f0-43a6-96de-1b7cb57134e1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:01.750982 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb06e5ae3dff4180a80bb90833206263', 'request_id': 'req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.751566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1006/2008] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:13:01.753920 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac76e2c-c5f0-43a6-96de-1b7cb57134e1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:01.764825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb06e5ae3dff4180a80bb90833206263', 'request_id': 'req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.775119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac76e2c-c5f0-43a6-96de-1b7cb57134e1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:01.779204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb06e5ae3dff4180a80bb90833206263', 'request_id': 'req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.815856 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] The token cache is being invalidate because project fb06e5ae3dff4180a80bb90833206263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:01.816177 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.817980 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a0e84ce1-51c3-4e33-b4af-81fb628b3d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:01.818912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1003/2009] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:01 2022] DELETE /identity/v3/projects/fb06e5ae3dff4180a80bb90833206263 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:01.825867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744d486-d9eb-4c1e-ba6f-021f1eb6eed8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:01.826265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744d486-d9eb-4c1e-ba6f-021f1eb6eed8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:01.826560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744d486-d9eb-4c1e-ba6f-021f1eb6eed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:01.886189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d744d486-d9eb-4c1e-ba6f-021f1eb6eed8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:01.887457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d744d486-d9eb-4c1e-ba6f-021f1eb6eed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:01.915706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ff6a1-5251-48de-b299-c60cbea3ddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:01.917077 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ff6a1-5251-48de-b299-c60cbea3ddc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:01.917437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ff6a1-5251-48de-b299-c60cbea3ddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:01.917784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ff6a1-5251-48de-b299-c60cbea3ddc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:01.918556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ff6a1-5251-48de-b299-c60cbea3ddc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:01.920903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ff6a1-5251-48de-b299-c60cbea3ddc1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:01.996587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1007/2010] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:01 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:02.001783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ff6a1-5251-48de-b299-c60cbea3ddc1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.005581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-975ff6a1-5251-48de-b299-c60cbea3ddc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:02.007832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:02.045651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1004/2011] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:02.056870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b523f77-059e-4cab-87df-6e2e23a4ad3e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.057168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b523f77-059e-4cab-87df-6e2e23a4ad3e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.057456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b523f77-059e-4cab-87df-6e2e23a4ad3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.095167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7b523f77-059e-4cab-87df-6e2e23a4ad3e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:02.096532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7b523f77-059e-4cab-87df-6e2e23a4ad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:02.153215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ff6a1-5251-48de-b299-c60cbea3ddc1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.158061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed01e1-a8ef-46fc-801d-ed2ae17bf6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.158863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed01e1-a8ef-46fc-801d-ed2ae17bf6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.159151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed01e1-a8ef-46fc-801d-ed2ae17bf6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.159429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed01e1-a8ef-46fc-801d-ed2ae17bf6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.160159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed01e1-a8ef-46fc-801d-ed2ae17bf6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.162264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed01e1-a8ef-46fc-801d-ed2ae17bf6d3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.208199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1008/2012] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:01 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:02.210487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed01e1-a8ef-46fc-801d-ed2ae17bf6d3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.212131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1005/2013] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:02.217799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b523f77-059e-4cab-87df-6e2e23a4ad3e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.236429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed01e1-a8ef-46fc-801d-ed2ae17bf6d3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.240860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b523f77-059e-4cab-87df-6e2e23a4ad3e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.251061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5b782-674c-4bdb-b393-fc6f7351f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.252234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5b782-674c-4bdb-b393-fc6f7351f5ec admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.253046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72094-43f2-4bfb-90b2-1c722b724715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.253917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72094-43f2-4bfb-90b2-1c722b724715 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.254418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5b782-674c-4bdb-b393-fc6f7351f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.254882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5b782-674c-4bdb-b393-fc6f7351f5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.255461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72094-43f2-4bfb-90b2-1c722b724715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.257002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72094-43f2-4bfb-90b2-1c722b724715 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.257759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5b782-674c-4bdb-b393-fc6f7351f5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.258707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72094-43f2-4bfb-90b2-1c722b724715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:02.260685 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72094-43f2-4bfb-90b2-1c722b724715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.262049 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5b782-674c-4bdb-b393-fc6f7351f5ec admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.263885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72094-43f2-4bfb-90b2-1c722b724715 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.284056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1009/2014] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:02.289123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1006/2015] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:13:02.293175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5b782-674c-4bdb-b393-fc6f7351f5ec admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.295111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72094-43f2-4bfb-90b2-1c722b724715 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.305378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5b782-674c-4bdb-b393-fc6f7351f5ec admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.311645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689546-424e-4333-9051-d9835641870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.313384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689546-424e-4333-9051-d9835641870d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.315392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689546-424e-4333-9051-d9835641870d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.315777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689546-424e-4333-9051-d9835641870d admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.316961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689546-424e-4333-9051-d9835641870d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.317896 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72094-43f2-4bfb-90b2-1c722b724715 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.320474 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689546-424e-4333-9051-d9835641870d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.330060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a5740-e99f-49b9-be29-a81b5674a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.332362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a5740-e99f-49b9-be29-a81b5674a56b admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.333285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a5740-e99f-49b9-be29-a81b5674a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.336174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a5740-e99f-49b9-be29-a81b5674a56b admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.336569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:02.337130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a5740-e99f-49b9-be29-a81b5674a56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.339164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a5740-e99f-49b9-be29-a81b5674a56b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.357919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1010/2016] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:02.360625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689546-424e-4333-9051-d9835641870d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.384989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689546-424e-4333-9051-d9835641870d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.402898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1007/2017] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:02 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:02.404264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130499b4-7fd7-46e6-aa58-4b878434d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.404424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a5740-e99f-49b9-be29-a81b5674a56b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.405181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130499b4-7fd7-46e6-aa58-4b878434d710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.405470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130499b4-7fd7-46e6-aa58-4b878434d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.405752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130499b4-7fd7-46e6-aa58-4b878434d710 admin admin] PATH_INFO: `/v3/projects/e3fd7fa775f243dd9f2e94a1bc975b7a/users/6df24de6ad6245d1aecb250f7ab8ee94/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.435128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130499b4-7fd7-46e6-aa58-4b878434d710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fd7fa775f243dd9f2e94a1bc975b7a, user_id=6df24de6ad6245d1aecb250f7ab8ee94, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.437834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130499b4-7fd7-46e6-aa58-4b878434d710 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.456098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1011/2018] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:02 2022] PUT /identity/v3/projects/e3fd7fa775f243dd9f2e94a1bc975b7a/users/6df24de6ad6245d1aecb250f7ab8ee94/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:02.469417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bf0f6-ec8a-4744-ab62-91b892886890 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.469715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bf0f6-ec8a-4744-ab62-91b892886890 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.470001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bf0f6-ec8a-4744-ab62-91b892886890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.515186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a5740-e99f-49b9-be29-a81b5674a56b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.522076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d41bf0f6-ec8a-4744-ab62-91b892886890 None None] MFA Rules not processed for user `6df24de6ad6245d1aecb250f7ab8ee94`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:02.523433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d41bf0f6-ec8a-4744-ab62-91b892886890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:02.637844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfed826-c1cb-4d0e-99da-183e63e0a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.639082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfed826-c1cb-4d0e-99da-183e63e0a737 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.639838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfed826-c1cb-4d0e-99da-183e63e0a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.640334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfed826-c1cb-4d0e-99da-183e63e0a737 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.641232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfed826-c1cb-4d0e-99da-183e63e0a737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.643651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfed826-c1cb-4d0e-99da-183e63e0a737 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.655173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1012/2019] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:02.656327 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bf0f6-ec8a-4744-ab62-91b892886890 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.663111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:02.673124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bf0f6-ec8a-4744-ab62-91b892886890 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.679332 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd3be1-4f49-4766-b761-99bfa925a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.680350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3be1-4f49-4766-b761-99bfa925a126 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.689963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1008/2020] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:02 2022] POST /identity/v3/users => generated 286 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:02.690386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3be1-4f49-4766-b761-99bfa925a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.690748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3be1-4f49-4766-b761-99bfa925a126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.691510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd3be1-4f49-4766-b761-99bfa925a126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.692734 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfed826-c1cb-4d0e-99da-183e63e0a737 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.697986 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd3be1-4f49-4766-b761-99bfa925a126 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.705358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfed826-c1cb-4d0e-99da-183e63e0a737 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.711331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e95d7c-cc55-463b-aabe-e29a1107bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.712313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e95d7c-cc55-463b-aabe-e29a1107bcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.712699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e95d7c-cc55-463b-aabe-e29a1107bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.713432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e95d7c-cc55-463b-aabe-e29a1107bcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.714746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e95d7c-cc55-463b-aabe-e29a1107bcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.715826 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e95d7c-cc55-463b-aabe-e29a1107bcb3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.732428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1009/2021] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:02.733374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e95d7c-cc55-463b-aabe-e29a1107bcb3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.746150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e95d7c-cc55-463b-aabe-e29a1107bcb3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.751570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d58b-27af-457f-8043-6ffa2ddc70fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.752397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d58b-27af-457f-8043-6ffa2ddc70fc admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.752753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d58b-27af-457f-8043-6ffa2ddc70fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.753104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d58b-27af-457f-8043-6ffa2ddc70fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.753909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0d58b-27af-457f-8043-6ffa2ddc70fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.756922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0d58b-27af-457f-8043-6ffa2ddc70fc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.769269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1013/2022] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:02 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:02.773722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd3be1-4f49-4766-b761-99bfa925a126 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.776969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1010/2023] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:02.778307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d58b-27af-457f-8043-6ffa2ddc70fc admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.809185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d58b-27af-457f-8043-6ffa2ddc70fc admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.892151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd3be1-4f49-4766-b761-99bfa925a126 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:02.898125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd70ad-cc91-41f4-ba07-76b028e4a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.899893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd70ad-cc91-41f4-ba07-76b028e4a9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.900242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd70ad-cc91-41f4-ba07-76b028e4a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.900552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd70ad-cc91-41f4-ba07-76b028e4a9c2 admin admin] PATH_INFO: `/v3/projects/dbb64335446c4a91bd7fd057c3f8b6bc/users/60ad848bc526417eaef8b868dcffd0f3/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.914459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bccc7-1765-45bb-9b26-afcb49291735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:02.915173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bccc7-1765-45bb-9b26-afcb49291735 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.915459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bccc7-1765-45bb-9b26-afcb49291735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.915740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bccc7-1765-45bb-9b26-afcb49291735 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.916495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bccc7-1765-45bb-9b26-afcb49291735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.919866 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd70ad-cc91-41f4-ba07-76b028e4a9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb64335446c4a91bd7fd057c3f8b6bc, user_id=60ad848bc526417eaef8b868dcffd0f3, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:02.921489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bccc7-1765-45bb-9b26-afcb49291735 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.922814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd70ad-cc91-41f4-ba07-76b028e4a9c2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:02.952631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1011/2024] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:02 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:02.956543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1014/2025] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:02 2022] PUT /identity/v3/projects/dbb64335446c4a91bd7fd057c3f8b6bc/users/60ad848bc526417eaef8b868dcffd0f3/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:02.965492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bccc7-1765-45bb-9b26-afcb49291735 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:02.967809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57cd8-1074-469e-867d-f1cb529016ec None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:02.968145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57cd8-1074-469e-867d-f1cb529016ec None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:02.968499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57cd8-1074-469e-867d-f1cb529016ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:02.984292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bccc7-1765-45bb-9b26-afcb49291735 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:03.011231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-47b57cd8-1074-469e-867d-f1cb529016ec None None] MFA Rules not processed for user `60ad848bc526417eaef8b868dcffd0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:03.012517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-47b57cd8-1074-469e-867d-f1cb529016ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:03.030767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:03.152291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1015/2026] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:03.156738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57cd8-1074-469e-867d-f1cb529016ec None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:03.161593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd3160-b508-4615-a9e0-3f96af33347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:03.162286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd3160-b508-4615-a9e0-3f96af33347f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.162574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd3160-b508-4615-a9e0-3f96af33347f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.162852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd3160-b508-4615-a9e0-3f96af33347f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.163596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd3160-b508-4615-a9e0-3f96af33347f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:03.165571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd3160-b508-4615-a9e0-3f96af33347f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:03.172362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57cd8-1074-469e-867d-f1cb529016ec None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:03.182326 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1012/2027] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:03.194729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd3160-b508-4615-a9e0-3f96af33347f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:03.197374 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143b7b-686c-415e-ad26-9c3184e13abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:03.198372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143b7b-686c-415e-ad26-9c3184e13abf admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.198820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143b7b-686c-415e-ad26-9c3184e13abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.199247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143b7b-686c-415e-ad26-9c3184e13abf admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.200135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd143b7b-686c-415e-ad26-9c3184e13abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:03.207462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd143b7b-686c-415e-ad26-9c3184e13abf admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:03.221541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd3160-b508-4615-a9e0-3f96af33347f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:03.242523 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f1551-fc00-43d0-b741-ff7523cf997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:03.243323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f1551-fc00-43d0-b741-ff7523cf997a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.243684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f1551-fc00-43d0-b741-ff7523cf997a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.244075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f1551-fc00-43d0-b741-ff7523cf997a admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.246848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f1551-fc00-43d0-b741-ff7523cf997a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:03.251065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f1551-fc00-43d0-b741-ff7523cf997a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:03.278055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1013/2028] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:03.282459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f1551-fc00-43d0-b741-ff7523cf997a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:03.286888 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1016/2029] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:03 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:03.292694 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143b7b-686c-415e-ad26-9c3184e13abf admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:03.312916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f1551-fc00-43d0-b741-ff7523cf997a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:03.414671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:03.445458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5500c-3873-4f54-95e1-4b3121855586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:03.446171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5500c-3873-4f54-95e1-4b3121855586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.446465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5500c-3873-4f54-95e1-4b3121855586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.446752 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5500c-3873-4f54-95e1-4b3121855586 admin admin] PATH_INFO: `/v3/projects/d093b9a5d4a94556980bef58a9279ab6/users/ed4ebcab1b944290924dcd7a2135b7c8/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.472096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143b7b-686c-415e-ad26-9c3184e13abf admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:03.483790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5500c-3873-4f54-95e1-4b3121855586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d093b9a5d4a94556980bef58a9279ab6, user_id=ed4ebcab1b944290924dcd7a2135b7c8, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:03.486674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5500c-3873-4f54-95e1-4b3121855586 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:03.487632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4655fd8-4962-47a3-920a-a473cf156b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:03.488459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4655fd8-4962-47a3-920a-a473cf156b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.490293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4655fd8-4962-47a3-920a-a473cf156b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.490600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4655fd8-4962-47a3-920a-a473cf156b68 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.491307 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4655fd8-4962-47a3-920a-a473cf156b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:03.500803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4655fd8-4962-47a3-920a-a473cf156b68 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:03.514951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1014/2030] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:03 2022] PUT /identity/v3/projects/d093b9a5d4a94556980bef58a9279ab6/users/ed4ebcab1b944290924dcd7a2135b7c8/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:03.526151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c36b33-647a-402d-bdf3-48441a3a481b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.526449 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c36b33-647a-402d-bdf3-48441a3a481b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.526737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c36b33-647a-402d-bdf3-48441a3a481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.567458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1017/2031] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:03 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:03.571254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4655fd8-4962-47a3-920a-a473cf156b68 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:03.575832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-87c36b33-647a-402d-bdf3-48441a3a481b None None] MFA Rules not processed for user `ed4ebcab1b944290924dcd7a2135b7c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:03.577112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-87c36b33-647a-402d-bdf3-48441a3a481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:03.594020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4655fd8-4962-47a3-920a-a473cf156b68 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:03.681990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12b97e-dd8a-4673-a66b-eb8f6ad8de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:03.685303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12b97e-dd8a-4673-a66b-eb8f6ad8de0c admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.685811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12b97e-dd8a-4673-a66b-eb8f6ad8de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.686330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12b97e-dd8a-4673-a66b-eb8f6ad8de0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.688068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12b97e-dd8a-4673-a66b-eb8f6ad8de0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:03.690800 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12b97e-dd8a-4673-a66b-eb8f6ad8de0c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:03.705829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1018/2032] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:13:03.709886 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12b97e-dd8a-4673-a66b-eb8f6ad8de0c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:03.723812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12b97e-dd8a-4673-a66b-eb8f6ad8de0c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:03.731650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db6972-b968-44a9-80c7-cf40d24706e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:03.732931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db6972-b968-44a9-80c7-cf40d24706e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.733396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db6972-b968-44a9-80c7-cf40d24706e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.734002 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db6972-b968-44a9-80c7-cf40d24706e2 admin admin] PATH_INFO: `/v3/projects/785a06a79e354fb0b573887e6afa66fc/users/cf9e6207d64a45efbf13ec24979ae0a1/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.747772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1015/2033] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:03.752650 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c36b33-647a-402d-bdf3-48441a3a481b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:03.759221 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db6972-b968-44a9-80c7-cf40d24706e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=785a06a79e354fb0b573887e6afa66fc, user_id=cf9e6207d64a45efbf13ec24979ae0a1, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:03.763123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db6972-b968-44a9-80c7-cf40d24706e2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:03.769788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:03.773250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c36b33-647a-402d-bdf3-48441a3a481b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:03.790131 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7002f81-ec8c-45cc-8a31-5fc6050a782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:03.790821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7002f81-ec8c-45cc-8a31-5fc6050a782c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.791112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7002f81-ec8c-45cc-8a31-5fc6050a782c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.791402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7002f81-ec8c-45cc-8a31-5fc6050a782c admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.792136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7002f81-ec8c-45cc-8a31-5fc6050a782c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:03.794090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7002f81-ec8c-45cc-8a31-5fc6050a782c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:03.798284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1019/2034] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:03 2022] PUT /identity/v3/projects/785a06a79e354fb0b573887e6afa66fc/users/cf9e6207d64a45efbf13ec24979ae0a1/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:03.799944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db6972-b968-44a9-80c7-cf40d24706e2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:03.845522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1016/2035] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:03 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:03.851248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7002f81-ec8c-45cc-8a31-5fc6050a782c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:03.970924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7002f81-ec8c-45cc-8a31-5fc6050a782c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:03.984459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be236e17-9364-4fac-aa84-69186081c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:03.985078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be236e17-9364-4fac-aa84-69186081c4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:03.985416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be236e17-9364-4fac-aa84-69186081c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:03.985718 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be236e17-9364-4fac-aa84-69186081c4ee admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:03.986472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be236e17-9364-4fac-aa84-69186081c4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:03.989252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be236e17-9364-4fac-aa84-69186081c4ee admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:04.011673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db6972-b968-44a9-80c7-cf40d24706e2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:04.039182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3969d-4653-4f77-96f3-7d80efc64360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:04.039950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3969d-4653-4f77-96f3-7d80efc64360 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.040381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3969d-4653-4f77-96f3-7d80efc64360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.040712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3969d-4653-4f77-96f3-7d80efc64360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.041517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3969d-4653-4f77-96f3-7d80efc64360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:04.043250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3969d-4653-4f77-96f3-7d80efc64360 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:04.050042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1017/2036] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:03 2022] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:04.054150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be236e17-9364-4fac-aa84-69186081c4ee admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:04.071083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be236e17-9364-4fac-aa84-69186081c4ee admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:04.078615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1020/2037] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:04.081624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3969d-4653-4f77-96f3-7d80efc64360 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:04.092753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e771ca-115b-4499-99ec-9582192eecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:04.093859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e771ca-115b-4499-99ec-9582192eecbf admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.094339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e771ca-115b-4499-99ec-9582192eecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.094885 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e771ca-115b-4499-99ec-9582192eecbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.095818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e771ca-115b-4499-99ec-9582192eecbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:04.097257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3969d-4653-4f77-96f3-7d80efc64360 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:04.099506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e771ca-115b-4499-99ec-9582192eecbf admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:04.103074 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb74e-c0ed-408d-854d-6a6b00cd9b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:04.110168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb74e-c0ed-408d-854d-6a6b00cd9b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.110168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb74e-c0ed-408d-854d-6a6b00cd9b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.110168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb74e-c0ed-408d-854d-6a6b00cd9b6c admin admin] PATH_INFO: `/v3/projects/785a06a79e354fb0b573887e6afa66fc/users/cf9e6207d64a45efbf13ec24979ae0a1/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.110168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccb74e-c0ed-408d-854d-6a6b00cd9b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=785a06a79e354fb0b573887e6afa66fc, user_id=cf9e6207d64a45efbf13ec24979ae0a1, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:04.110168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccb74e-c0ed-408d-854d-6a6b00cd9b6c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:04.136529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1021/2038] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:04 2022] PUT /identity/v3/projects/785a06a79e354fb0b573887e6afa66fc/users/cf9e6207d64a45efbf13ec24979ae0a1/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:04.139563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03cde5-3200-41f6-88dd-1534a133218d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.145712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03cde5-3200-41f6-88dd-1534a133218d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.147117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03cde5-3200-41f6-88dd-1534a133218d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.154057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1018/2039] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:04.155721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e771ca-115b-4499-99ec-9582192eecbf admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:04.178872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e771ca-115b-4499-99ec-9582192eecbf admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:04.202773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:04.230060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-da03cde5-3200-41f6-88dd-1534a133218d None None] MFA Rules not processed for user `cf9e6207d64a45efbf13ec24979ae0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:04.234512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-da03cde5-3200-41f6-88dd-1534a133218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:04.304158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fce12c-3ccf-49db-8089-8b13c7f1e16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:04.319230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce12c-3ccf-49db-8089-8b13c7f1e16a admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.319531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce12c-3ccf-49db-8089-8b13c7f1e16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.320123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce12c-3ccf-49db-8089-8b13c7f1e16a admin admin] PATH_INFO: `/v3/projects/7cc29ad6d70c474f951c0b8ce07370ab/users/098838f5ab4545f4a0e071481ca13fca/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.342712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fce12c-3ccf-49db-8089-8b13c7f1e16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc29ad6d70c474f951c0b8ce07370ab, user_id=098838f5ab4545f4a0e071481ca13fca, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:04.345715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fce12c-3ccf-49db-8089-8b13c7f1e16a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:04.365425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1019/2040] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:04 2022] PUT /identity/v3/projects/7cc29ad6d70c474f951c0b8ce07370ab/users/098838f5ab4545f4a0e071481ca13fca/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:04.371355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fce12c-3ccf-49db-8089-8b13c7f1e16a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:04.400959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1022/2041] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:04.418110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03cde5-3200-41f6-88dd-1534a133218d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:04.419782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-da03cde5-3200-41f6-88dd-1534a133218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:04.449435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fce12c-3ccf-49db-8089-8b13c7f1e16a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:04.455000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca9f4a-4316-4c2a-8f51-edb91b2986f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:04.455781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca9f4a-4316-4c2a-8f51-edb91b2986f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.456170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca9f4a-4316-4c2a-8f51-edb91b2986f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.456539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca9f4a-4316-4c2a-8f51-edb91b2986f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.457416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca9f4a-4316-4c2a-8f51-edb91b2986f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:04.460127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca9f4a-4316-4c2a-8f51-edb91b2986f1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:04.474199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1020/2042] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:04.475664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca9f4a-4316-4c2a-8f51-edb91b2986f1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:04.486142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca9f4a-4316-4c2a-8f51-edb91b2986f1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:04.491286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413a8e-a32f-4de7-b57b-15af4da60887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:04.492530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413a8e-a32f-4de7-b57b-15af4da60887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.492820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413a8e-a32f-4de7-b57b-15af4da60887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.493124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413a8e-a32f-4de7-b57b-15af4da60887 admin admin] PATH_INFO: `/v3/projects/7cc29ad6d70c474f951c0b8ce07370ab/users/098838f5ab4545f4a0e071481ca13fca/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.495244 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9413a8e-a32f-4de7-b57b-15af4da60887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc29ad6d70c474f951c0b8ce07370ab, user_id=098838f5ab4545f4a0e071481ca13fca, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:04.498005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9413a8e-a32f-4de7-b57b-15af4da60887 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:04.506431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03cde5-3200-41f6-88dd-1534a133218d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:04.511938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1021/2043] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:04 2022] PUT /identity/v3/projects/7cc29ad6d70c474f951c0b8ce07370ab/users/098838f5ab4545f4a0e071481ca13fca/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:04.521504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6214-4610-402d-8315-651084d0b3cf None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.521799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6214-4610-402d-8315-651084d0b3cf None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.522081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6214-4610-402d-8315-651084d0b3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.534918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:04.573753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-533c6214-4610-402d-8315-651084d0b3cf None None] MFA Rules not processed for user `098838f5ab4545f4a0e071481ca13fca`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:04.576243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-533c6214-4610-402d-8315-651084d0b3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:04.609677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d58b0-a711-4817-bc06-c42ca6c16413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:04.610369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d58b0-a711-4817-bc06-c42ca6c16413 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.610638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d58b0-a711-4817-bc06-c42ca6c16413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.610919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d58b0-a711-4817-bc06-c42ca6c16413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.731880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d58b0-a711-4817-bc06-c42ca6c16413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:04.733996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1022/2044] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:04.734959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d58b0-a711-4817-bc06-c42ca6c16413 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:04.749055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c6214-4610-402d-8315-651084d0b3cf None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:04.750601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-533c6214-4610-402d-8315-651084d0b3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:04.763756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1023/2045] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:04.768000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c6214-4610-402d-8315-651084d0b3cf None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:04.778690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777af8-81ed-46b3-b1c5-50986ceb7365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:04.779227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777af8-81ed-46b3-b1c5-50986ceb7365 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:04.779752 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777af8-81ed-46b3-b1c5-50986ceb7365 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:04.780203 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777af8-81ed-46b3-b1c5-50986ceb7365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:04.790350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:04.883086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56777af8-81ed-46b3-b1c5-50986ceb7365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:04.884677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56777af8-81ed-46b3-b1c5-50986ceb7365 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:04.895842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1023/2046] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:05.693127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d58b0-a711-4817-bc06-c42ca6c16413 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:05.854973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d58b0-a711-4817-bc06-c42ca6c16413 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:05.862648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:05.864140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:05.864434 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:05.865078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] PATH_INFO: `/v3/users/60ad848bc526417eaef8b868dcffd0f3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:05.867321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ad848bc526417eaef8b868dcffd0f3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:05.869573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:05.954615 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ad848bc526417eaef8b868dcffd0f3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:05.971648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ad848bc526417eaef8b868dcffd0f3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:06.001470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ad848bc526417eaef8b868dcffd0f3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:06.002865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ad848bc526417eaef8b868dcffd0f3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:06.003715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ad848bc526417eaef8b868dcffd0f3'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:06.006343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:06.050188 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1024/2047] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:05 2022] DELETE /identity/v3/users/60ad848bc526417eaef8b868dcffd0f3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:06.055003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131891f5-fa7b-435f-b9e2-d955883c4b60 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:06.055479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131891f5-fa7b-435f-b9e2-d955883c4b60 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:06.055714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131891f5-fa7b-435f-b9e2-d955883c4b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:06.091665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-131891f5-fa7b-435f-b9e2-d955883c4b60 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:06.091665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-131891f5-fa7b-435f-b9e2-d955883c4b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:06.179123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1024/2048] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:06.198264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:06.200675 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:06.288065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0b0fa-74a0-43f7-9057-00fc4976116c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:06.292318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1dab9-bb78-47c0-ab0e-92b9d8d0b90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:06.293136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1dab9-bb78-47c0-ab0e-92b9d8d0b90f service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:06.294716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1dab9-bb78-47c0-ab0e-92b9d8d0b90f service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:06.294716 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1dab9-bb78-47c0-ab0e-92b9d8d0b90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:06.306829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1dab9-bb78-47c0-ab0e-92b9d8d0b90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:06.309125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1dab9-bb78-47c0-ab0e-92b9d8d0b90f service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:06.323017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1025/2049] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:06.360867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d710-9724-430c-aabe-a563ec285f71 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:06.361281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d710-9724-430c-aabe-a563ec285f71 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:06.361662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d710-9724-430c-aabe-a563ec285f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:06.426269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-b827d710-9724-430c-aabe-a563ec285f71 None None] MFA Rules not processed for user `c71e317587f6475790af1cc766215358`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:06.427863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b827d710-9724-430c-aabe-a563ec285f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:06.583880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1025/2050] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:06.588840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1dab9-bb78-47c0-ab0e-92b9d8d0b90f service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:06.597529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-33f1dab9-bb78-47c0-ab0e-92b9d8d0b90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:06.619241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1dab9-bb78-47c0-ab0e-92b9d8d0b90f service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:06.624764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d256cc-7b70-4fc2-9a1d-5b59ec72e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:06.625743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d256cc-7b70-4fc2-9a1d-5b59ec72e77e admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:06.626232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d256cc-7b70-4fc2-9a1d-5b59ec72e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:06.626736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d256cc-7b70-4fc2-9a1d-5b59ec72e77e admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:06.628397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d256cc-7b70-4fc2-9a1d-5b59ec72e77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:06.633094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d256cc-7b70-4fc2-9a1d-5b59ec72e77e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:06.678680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1026/2051] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:06 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:06.682963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d710-9724-430c-aabe-a563ec285f71 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:06.698874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d710-9724-430c-aabe-a563ec285f71 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:06.790610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:06.844801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf829ff-429c-48b7-aca5-83f1e72f3c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:06.845517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf829ff-429c-48b7-aca5-83f1e72f3c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:06.845861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf829ff-429c-48b7-aca5-83f1e72f3c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:06.846224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf829ff-429c-48b7-aca5-83f1e72f3c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:06.846918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf829ff-429c-48b7-aca5-83f1e72f3c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:06.851143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf829ff-429c-48b7-aca5-83f1e72f3c26 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:06.895927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1026/2052] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:06 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:06.896258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d256cc-7b70-4fc2-9a1d-5b59ec72e77e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:06.907873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d256cc-7b70-4fc2-9a1d-5b59ec72e77e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:06.914479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bfb6f-a9e2-4b20-9c21-0c740d00f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:06.915445 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bfb6f-a9e2-4b20-9c21-0c740d00f167 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:06.915980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bfb6f-a9e2-4b20-9c21-0c740d00f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:06.916465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bfb6f-a9e2-4b20-9c21-0c740d00f167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:06.917440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bfb6f-a9e2-4b20-9c21-0c740d00f167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:06.919753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bfb6f-a9e2-4b20-9c21-0c740d00f167 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:06.934022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1027/2053] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:06.938071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf829ff-429c-48b7-aca5-83f1e72f3c26 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:06.976596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf829ff-429c-48b7-aca5-83f1e72f3c26 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:06.987510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b6c3e-af97-4d46-b386-6d5f4588a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:06.997580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b6c3e-af97-4d46-b386-6d5f4588a832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:06.997896 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b6c3e-af97-4d46-b386-6d5f4588a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:06.998249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b6c3e-af97-4d46-b386-6d5f4588a832 admin admin] PATH_INFO: `/v3/projects/da24e434e27a42b4a0a1f35310747d1b/users/d225039cc76345388cabe3b8d05529cc/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:07.037730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bfb6f-a9e2-4b20-9c21-0c740d00f167 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:07.039826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-899bfb6f-a9e2-4b20-9c21-0c740d00f167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:07.043671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b6c3e-af97-4d46-b386-6d5f4588a832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da24e434e27a42b4a0a1f35310747d1b, user_id=d225039cc76345388cabe3b8d05529cc, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:07.055688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b6c3e-af97-4d46-b386-6d5f4588a832 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:07.095044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1027/2054] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:06 2022] PUT /identity/v3/projects/da24e434e27a42b4a0a1f35310747d1b/users/d225039cc76345388cabe3b8d05529cc/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:07.096167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b6c3e-af97-4d46-b386-6d5f4588a832 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:07.163817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bfb6f-a9e2-4b20-9c21-0c740d00f167 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:07.266877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b6c3e-af97-4d46-b386-6d5f4588a832 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:07.271252 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5880ff1-191a-468d-994e-bc05114cd2c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:07.272027 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880ff1-191a-468d-994e-bc05114cd2c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:07.272348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880ff1-191a-468d-994e-bc05114cd2c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:07.272627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880ff1-191a-468d-994e-bc05114cd2c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:07.274709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a5880ff1-191a-468d-994e-bc05114cd2c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:07.282044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f589e-21bc-46e6-bc6c-01d841abb5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:07.283097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f589e-21bc-46e6-bc6c-01d841abb5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:07.283528 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f589e-21bc-46e6-bc6c-01d841abb5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:07.284257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f589e-21bc-46e6-bc6c-01d841abb5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:07.285612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f589e-21bc-46e6-bc6c-01d841abb5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:07.288738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f589e-21bc-46e6-bc6c-01d841abb5dc admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:07.328774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1028/2055] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:07.333314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f589e-21bc-46e6-bc6c-01d841abb5dc admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:07.351721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f589e-21bc-46e6-bc6c-01d841abb5dc admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:07.357034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965807-d162-4878-8a87-08829a1afbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:07.358064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965807-d162-4878-8a87-08829a1afbad admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:07.358425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965807-d162-4878-8a87-08829a1afbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:07.358962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965807-d162-4878-8a87-08829a1afbad admin admin] PATH_INFO: `/v3/projects/da24e434e27a42b4a0a1f35310747d1b/users/d225039cc76345388cabe3b8d05529cc/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:07.361937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04965807-d162-4878-8a87-08829a1afbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=da24e434e27a42b4a0a1f35310747d1b, user_id=d225039cc76345388cabe3b8d05529cc, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:07.365817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04965807-d162-4878-8a87-08829a1afbad admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:07.370725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:07.382130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1029/2056] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:07 2022] PUT /identity/v3/projects/da24e434e27a42b4a0a1f35310747d1b/users/d225039cc76345388cabe3b8d05529cc/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:07.469417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5880ff1-191a-468d-994e-bc05114cd2c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:07.470885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5880ff1-191a-468d-994e-bc05114cd2c2 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:07.482054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1028/2057] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:07.700471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965807-d162-4878-8a87-08829a1afbad admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:07.704216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-04965807-d162-4878-8a87-08829a1afbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:07.889365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965807-d162-4878-8a87-08829a1afbad admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:07.903927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:07.904864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:07.905196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:07.905587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] PATH_INFO: `/v3/projects/dbb64335446c4a91bd7fd057c3f8b6bc` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:07.907929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb64335446c4a91bd7fd057c3f8b6bc)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:07.910533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:07.995568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:08.049875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb64335446c4a91bd7fd057c3f8b6bc', 'request_id': 'req-55b95622-a401-4a4d-94b6-06db49ba5615'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.064201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb64335446c4a91bd7fd057c3f8b6bc', 'request_id': 'req-55b95622-a401-4a4d-94b6-06db49ba5615'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.078410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb64335446c4a91bd7fd057c3f8b6bc', 'request_id': 'req-55b95622-a401-4a4d-94b6-06db49ba5615'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.119144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] The token cache is being invalidate because project dbb64335446c4a91bd7fd057c3f8b6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:08.119776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.122291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.133912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1030/2058] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:07 2022] DELETE /identity/v3/projects/dbb64335446c4a91bd7fd057c3f8b6bc => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:08.135455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5880ff1-191a-468d-994e-bc05114cd2c2 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:08.161781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5880ff1-191a-468d-994e-bc05114cd2c2 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:08.349047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:08.352017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:08.352493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:08.352970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] PATH_INFO: `/v3/users/cf9e6207d64a45efbf13ec24979ae0a1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:08.359149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9e6207d64a45efbf13ec24979ae0a1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:08.364126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:08.488148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9e6207d64a45efbf13ec24979ae0a1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.507151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9e6207d64a45efbf13ec24979ae0a1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.534722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9e6207d64a45efbf13ec24979ae0a1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.537089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9e6207d64a45efbf13ec24979ae0a1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.537971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9e6207d64a45efbf13ec24979ae0a1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:08.573384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1029/2059] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:08 2022] DELETE /identity/v3/users/cf9e6207d64a45efbf13ec24979ae0a1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:08.606100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:08.607721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:08.753989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b95622-a401-4a4d-94b6-06db49ba5615 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:08.880197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1ef2a-4439-4360-801d-9491434bec45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:08.881555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1ef2a-4439-4360-801d-9491434bec45 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:08.882039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1ef2a-4439-4360-801d-9491434bec45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:08.882240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1ef2a-4439-4360-801d-9491434bec45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:08.885052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-72a1ef2a-4439-4360-801d-9491434bec45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:09.031847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1ef2a-4439-4360-801d-9491434bec45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:09.033591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1ef2a-4439-4360-801d-9491434bec45 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:09.062586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1031/2060] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:09.310630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:09.313136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:09.411696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:09.437158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef1d8-7dc8-4f26-9645-a9e3ac48101f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:09.445327 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:09.446450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:09.446838 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:09.447222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] PATH_INFO: `/v3/projects/785a06a79e354fb0b573887e6afa66fc` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:09.448753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=785a06a79e354fb0b573887e6afa66fc)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:09.451475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:09.528757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785a06a79e354fb0b573887e6afa66fc', 'request_id': 'req-b1b08446-c887-490c-beb1-d51439432157'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:09.537972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785a06a79e354fb0b573887e6afa66fc', 'request_id': 'req-b1b08446-c887-490c-beb1-d51439432157'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:09.554260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785a06a79e354fb0b573887e6afa66fc', 'request_id': 'req-b1b08446-c887-490c-beb1-d51439432157'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:09.570669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] The token cache is being invalidate because project 785a06a79e354fb0b573887e6afa66fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:09.572968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:09.573562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b1b08446-c887-490c-beb1-d51439432157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:09.576423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1030/2061] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:09 2022] DELETE /identity/v3/projects/785a06a79e354fb0b573887e6afa66fc => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:09.581211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c8255-e05e-40f5-9e22-977298ca3a85 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:09.581772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c8255-e05e-40f5-9e22-977298ca3a85 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:09.581974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c8255-e05e-40f5-9e22-977298ca3a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:09.606216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bb8c8255-e05e-40f5-9e22-977298ca3a85 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:09.608277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bb8c8255-e05e-40f5-9e22-977298ca3a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:09.634631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:09.705952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1032/2062] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:09.714840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041cfef-d0ce-4db5-8a51-5d08088f1970 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:09.715200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041cfef-d0ce-4db5-8a51-5d08088f1970 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:09.715551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041cfef-d0ce-4db5-8a51-5d08088f1970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:09.737357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2041cfef-d0ce-4db5-8a51-5d08088f1970 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:09.739353 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2041cfef-d0ce-4db5-8a51-5d08088f1970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:09.756708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1031/2063] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:09.757330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c8255-e05e-40f5-9e22-977298ca3a85 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:09.773818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c8255-e05e-40f5-9e22-977298ca3a85 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:09.779015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4cac2-3b2e-42b0-b208-99a45818762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:09.779791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4cac2-3b2e-42b0-b208-99a45818762e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:09.780173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4cac2-3b2e-42b0-b208-99a45818762e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:09.780522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4cac2-3b2e-42b0-b208-99a45818762e admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:09.781408 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4cac2-3b2e-42b0-b208-99a45818762e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:09.781906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4cac2-3b2e-42b0-b208-99a45818762e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:09.783630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4cac2-3b2e-42b0-b208-99a45818762e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:09.805612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1033/2064] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:13:09.811114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041cfef-d0ce-4db5-8a51-5d08088f1970 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:09.830687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041cfef-d0ce-4db5-8a51-5d08088f1970 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:09.841154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf1b1d-8f8d-4779-85ed-e0825645cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:09.841855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf1b1d-8f8d-4779-85ed-e0825645cc9a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:09.842148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf1b1d-8f8d-4779-85ed-e0825645cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:09.842561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf1b1d-8f8d-4779-85ed-e0825645cc9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:09.843174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf1b1d-8f8d-4779-85ed-e0825645cc9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:09.845152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf1b1d-8f8d-4779-85ed-e0825645cc9a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:09.932496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1032/2065] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:09 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:09.934179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4cac2-3b2e-42b0-b208-99a45818762e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:09.948925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4cac2-3b2e-42b0-b208-99a45818762e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:10.054946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcc23b-ad9f-44b1-bd6b-db2752cd9f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:10.056223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcc23b-ad9f-44b1-bd6b-db2752cd9f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:10.056716 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcc23b-ad9f-44b1-bd6b-db2752cd9f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:10.057215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcc23b-ad9f-44b1-bd6b-db2752cd9f82 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:10.058189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcc23b-ad9f-44b1-bd6b-db2752cd9f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:10.062335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcc23b-ad9f-44b1-bd6b-db2752cd9f82 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:10.132518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf1b1d-8f8d-4779-85ed-e0825645cc9a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:10.144073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1034/2066] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:09 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:10.145103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf1b1d-8f8d-4779-85ed-e0825645cc9a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:10.150086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7efa-4f25-4b91-a639-2c26aa295ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:10.150768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7efa-4f25-4b91-a639-2c26aa295ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:10.151056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7efa-4f25-4b91-a639-2c26aa295ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:10.151339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7efa-4f25-4b91-a639-2c26aa295ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:10.152394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df7efa-4f25-4b91-a639-2c26aa295ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:10.154023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df7efa-4f25-4b91-a639-2c26aa295ea1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:10.171831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcc23b-ad9f-44b1-bd6b-db2752cd9f82 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:10.179298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1033/2067] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:10.185954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcc23b-ad9f-44b1-bd6b-db2752cd9f82 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:10.191786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e4716-03fe-42dc-a8bf-5bd13284bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:10.192878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e4716-03fe-42dc-a8bf-5bd13284bbbf admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:10.193336 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e4716-03fe-42dc-a8bf-5bd13284bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:10.193721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e4716-03fe-42dc-a8bf-5bd13284bbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:10.194624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e4716-03fe-42dc-a8bf-5bd13284bbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:10.196424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e4716-03fe-42dc-a8bf-5bd13284bbbf admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:10.211684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1035/2068] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:10.216290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7efa-4f25-4b91-a639-2c26aa295ea1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:10.232648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7efa-4f25-4b91-a639-2c26aa295ea1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:10.244610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b1cdc-a873-4ec8-b4a6-fad144365a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:10.245783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b1cdc-a873-4ec8-b4a6-fad144365a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:10.246175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b1cdc-a873-4ec8-b4a6-fad144365a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:10.246574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b1cdc-a873-4ec8-b4a6-fad144365a45 admin admin] PATH_INFO: `/v3/projects/bee90a5bc6d84a2983b313a5ca95adbf/users/672872716ca24aed9b997c86f0c8b6c5/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:10.284682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b1cdc-a873-4ec8-b4a6-fad144365a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee90a5bc6d84a2983b313a5ca95adbf, user_id=672872716ca24aed9b997c86f0c8b6c5, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:10.290989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b1cdc-a873-4ec8-b4a6-fad144365a45 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:10.338171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1034/2069] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:10 2022] PUT /identity/v3/projects/bee90a5bc6d84a2983b313a5ca95adbf/users/672872716ca24aed9b997c86f0c8b6c5/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:10.345096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb89bc2-54c6-4375-ac92-62ef4d4685b0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:10.345515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb89bc2-54c6-4375-ac92-62ef4d4685b0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:10.346021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb89bc2-54c6-4375-ac92-62ef4d4685b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:10.398331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bfb89bc2-54c6-4375-ac92-62ef4d4685b0 None None] MFA Rules not processed for user `672872716ca24aed9b997c86f0c8b6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:10.400878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bfb89bc2-54c6-4375-ac92-62ef4d4685b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:10.553604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1036/2070] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:10.558913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b1cdc-a873-4ec8-b4a6-fad144365a45 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:10.717011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b1cdc-a873-4ec8-b4a6-fad144365a45 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:10.724040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e775a-eb19-4dc8-b7ca-803a26dbb164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:10.724723 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e775a-eb19-4dc8-b7ca-803a26dbb164 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:10.725018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e775a-eb19-4dc8-b7ca-803a26dbb164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:10.726378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e775a-eb19-4dc8-b7ca-803a26dbb164 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:10.727185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e775a-eb19-4dc8-b7ca-803a26dbb164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:10.732056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e775a-eb19-4dc8-b7ca-803a26dbb164 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:10.794039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:10.802523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1035/2071] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:10 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:10.814079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb89bc2-54c6-4375-ac92-62ef4d4685b0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:10.830489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb89bc2-54c6-4375-ac92-62ef4d4685b0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:10.859738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:10.964160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaba529-b3a9-4ced-8d9c-76c20abfa2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:10.965080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaba529-b3a9-4ced-8d9c-76c20abfa2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:10.965580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaba529-b3a9-4ced-8d9c-76c20abfa2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:10.966010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaba529-b3a9-4ced-8d9c-76c20abfa2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:10.966864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaba529-b3a9-4ced-8d9c-76c20abfa2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:10.969423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaba529-b3a9-4ced-8d9c-76c20abfa2f6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:11.003708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1037/2072] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:10 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:11.008135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e775a-eb19-4dc8-b7ca-803a26dbb164 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:11.028379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e775a-eb19-4dc8-b7ca-803a26dbb164 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:11.034164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9980-32a2-41d5-a688-003e0256d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:11.034903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9980-32a2-41d5-a688-003e0256d3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:11.035284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9980-32a2-41d5-a688-003e0256d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:11.035555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9980-32a2-41d5-a688-003e0256d3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:11.036330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a9980-32a2-41d5-a688-003e0256d3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:11.038180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a9980-32a2-41d5-a688-003e0256d3e9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:11.060132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1036/2073] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:11.064636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaba529-b3a9-4ced-8d9c-76c20abfa2f6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:11.076554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaba529-b3a9-4ced-8d9c-76c20abfa2f6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:11.083258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba274359-ceb3-48bd-93e0-9f6e322aaf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:11.084391 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274359-ceb3-48bd-93e0-9f6e322aaf49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:11.084745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274359-ceb3-48bd-93e0-9f6e322aaf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:11.085119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274359-ceb3-48bd-93e0-9f6e322aaf49 admin admin] PATH_INFO: `/v3/projects/2b9eaa1333dd46899fd75422acce6b9d/users/6f720aae8f264d939e278efd509ec2d6/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:11.122480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba274359-ceb3-48bd-93e0-9f6e322aaf49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9eaa1333dd46899fd75422acce6b9d, user_id=6f720aae8f264d939e278efd509ec2d6, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:11.125330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba274359-ceb3-48bd-93e0-9f6e322aaf49 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:11.149953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1038/2074] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:11 2022] PUT /identity/v3/projects/2b9eaa1333dd46899fd75422acce6b9d/users/6f720aae8f264d939e278efd509ec2d6/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:11.155005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9980-32a2-41d5-a688-003e0256d3e9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:11.172561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9980-32a2-41d5-a688-003e0256d3e9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:11.261091 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dab30a-efb0-47be-8492-7206aec1016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:11.262035 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dab30a-efb0-47be-8492-7206aec1016d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:11.262386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dab30a-efb0-47be-8492-7206aec1016d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:11.262794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dab30a-efb0-47be-8492-7206aec1016d admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:11.263770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dab30a-efb0-47be-8492-7206aec1016d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:11.266512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dab30a-efb0-47be-8492-7206aec1016d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:11.294129 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1037/2075] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:11.296458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba274359-ceb3-48bd-93e0-9f6e322aaf49 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:11.310510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba274359-ceb3-48bd-93e0-9f6e322aaf49 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:11.316946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d79c2-ba8c-4fa5-9dc0-37594195c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:11.318107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d79c2-ba8c-4fa5-9dc0-37594195c65c admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:11.318907 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d79c2-ba8c-4fa5-9dc0-37594195c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:11.319204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d79c2-ba8c-4fa5-9dc0-37594195c65c admin admin] PATH_INFO: `/v3/projects/2b9eaa1333dd46899fd75422acce6b9d/users/6f720aae8f264d939e278efd509ec2d6/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:11.322646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d79c2-ba8c-4fa5-9dc0-37594195c65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9eaa1333dd46899fd75422acce6b9d, user_id=6f720aae8f264d939e278efd509ec2d6, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:11.327110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d79c2-ba8c-4fa5-9dc0-37594195c65c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:11.343148 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1039/2076] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:11 2022] PUT /identity/v3/projects/2b9eaa1333dd46899fd75422acce6b9d/users/6f720aae8f264d939e278efd509ec2d6/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:11.354986 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28483f-58e1-4669-bcdf-9bbb393e3c42 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:11.355889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28483f-58e1-4669-bcdf-9bbb393e3c42 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:11.356632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28483f-58e1-4669-bcdf-9bbb393e3c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:11.393590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1d28483f-58e1-4669-bcdf-9bbb393e3c42 None None] MFA Rules not processed for user `6f720aae8f264d939e278efd509ec2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:11.394855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1d28483f-58e1-4669-bcdf-9bbb393e3c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:11.508555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1038/2077] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:11.518586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d79c2-ba8c-4fa5-9dc0-37594195c65c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:11.520975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-300d79c2-ba8c-4fa5-9dc0-37594195c65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:11.656938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d79c2-ba8c-4fa5-9dc0-37594195c65c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:11.682753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070fa3c-420e-4f47-aafe-abb671e202cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:11.683324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070fa3c-420e-4f47-aafe-abb671e202cb service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:11.683614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070fa3c-420e-4f47-aafe-abb671e202cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:11.684013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070fa3c-420e-4f47-aafe-abb671e202cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:11.721290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070fa3c-420e-4f47-aafe-abb671e202cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:11.725863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070fa3c-420e-4f47-aafe-abb671e202cb service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:11.758553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1040/2078] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:11.833696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28483f-58e1-4669-bcdf-9bbb393e3c42 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:11.837790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1d28483f-58e1-4669-bcdf-9bbb393e3c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:11.856014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28483f-58e1-4669-bcdf-9bbb393e3c42 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:11.884081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e09c7d-649c-42b1-ad54-298e8b4bba83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:11.885032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e09c7d-649c-42b1-ad54-298e8b4bba83 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:11.885450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e09c7d-649c-42b1-ad54-298e8b4bba83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:11.885885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e09c7d-649c-42b1-ad54-298e8b4bba83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:12.003009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e09c7d-649c-42b1-ad54-298e8b4bba83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:12.019163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e09c7d-649c-42b1-ad54-298e8b4bba83 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:12.043777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1039/2079] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:13.936296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070fa3c-420e-4f47-aafe-abb671e202cb service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:13.937793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6070fa3c-420e-4f47-aafe-abb671e202cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:14.120147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070fa3c-420e-4f47-aafe-abb671e202cb service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:14.127736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:14.129532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:14.130057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:14.130545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] PATH_INFO: `/v3/users/6df24de6ad6245d1aecb250f7ab8ee94` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:14.132832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df24de6ad6245d1aecb250f7ab8ee94)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:14.137026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:14.155924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:14.244154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df24de6ad6245d1aecb250f7ab8ee94'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:14.260858 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df24de6ad6245d1aecb250f7ab8ee94'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:14.262081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df24de6ad6245d1aecb250f7ab8ee94'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:14.320602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df24de6ad6245d1aecb250f7ab8ee94'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:14.326435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df24de6ad6245d1aecb250f7ab8ee94'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:14.386783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1041/2080] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:13 2022] DELETE /identity/v3/users/6df24de6ad6245d1aecb250f7ab8ee94 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:14.391962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f3759-dcfb-43fc-9413-1f8a5903aae7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:14.393100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f3759-dcfb-43fc-9413-1f8a5903aae7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:14.393724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f3759-dcfb-43fc-9413-1f8a5903aae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:14.454805 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-437f3759-dcfb-43fc-9413-1f8a5903aae7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:14.456577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-437f3759-dcfb-43fc-9413-1f8a5903aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:14.463376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:14.574006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1040/2081] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:14.589175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:14.596913 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:14.705405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2cb2a-9b96-48ed-8076-aa5156731f55 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:14.714099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbe3e-0d4c-44b5-a7ec-29f090b5aa4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:14.715105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbe3e-0d4c-44b5-a7ec-29f090b5aa4c service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:14.715626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbe3e-0d4c-44b5-a7ec-29f090b5aa4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:14.717077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbe3e-0d4c-44b5-a7ec-29f090b5aa4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:14.737497 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbe3e-0d4c-44b5-a7ec-29f090b5aa4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:14.740394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbe3e-0d4c-44b5-a7ec-29f090b5aa4c service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:14.751755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1042/2082] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:15.357243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f3759-dcfb-43fc-9413-1f8a5903aae7 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:15.359080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-437f3759-dcfb-43fc-9413-1f8a5903aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:15.390856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f3759-dcfb-43fc-9413-1f8a5903aae7 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:15.405476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:15.407027 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:15.407637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:15.408089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] PATH_INFO: `/v3/projects/e3fd7fa775f243dd9f2e94a1bc975b7a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:15.411276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3fd7fa775f243dd9f2e94a1bc975b7a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:15.414032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:15.523642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3fd7fa775f243dd9f2e94a1bc975b7a', 'request_id': 'req-52a93e35-4201-4664-bd7d-bf6255e40303'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.532982 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3fd7fa775f243dd9f2e94a1bc975b7a', 'request_id': 'req-52a93e35-4201-4664-bd7d-bf6255e40303'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.542961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3fd7fa775f243dd9f2e94a1bc975b7a', 'request_id': 'req-52a93e35-4201-4664-bd7d-bf6255e40303'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.570338 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] The token cache is being invalidate because project e3fd7fa775f243dd9f2e94a1bc975b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:15.571002 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.572324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-52a93e35-4201-4664-bd7d-bf6255e40303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.575152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1041/2083] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:15 2022] DELETE /identity/v3/projects/e3fd7fa775f243dd9f2e94a1bc975b7a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:15.579194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbe3e-0d4c-44b5-a7ec-29f090b5aa4c service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:15.598541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbe3e-0d4c-44b5-a7ec-29f090b5aa4c service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:15.650721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8219-16a0-46b4-a1f8-937c1e8d35cc None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:15.651020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8219-16a0-46b4-a1f8-937c1e8d35cc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:15.651390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8219-16a0-46b4-a1f8-937c1e8d35cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:15.711437 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:15.712380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:15.712666 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:15.712948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] PATH_INFO: `/v3/users/ed4ebcab1b944290924dcd7a2135b7c8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:15.714197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4ebcab1b944290924dcd7a2135b7c8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:15.716256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:15.735536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b7bf8219-16a0-46b4-a1f8-937c1e8d35cc None None] MFA Rules not processed for user `d225039cc76345388cabe3b8d05529cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:15.737630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b7bf8219-16a0-46b4-a1f8-937c1e8d35cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:15.805972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:15.823792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4ebcab1b944290924dcd7a2135b7c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.837066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4ebcab1b944290924dcd7a2135b7c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.838065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4ebcab1b944290924dcd7a2135b7c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.858369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4ebcab1b944290924dcd7a2135b7c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.859715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4ebcab1b944290924dcd7a2135b7c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:15.870897 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1042/2084] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:15.880172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1043/2085] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:15 2022] DELETE /identity/v3/users/ed4ebcab1b944290924dcd7a2135b7c8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:15.896986 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf8219-16a0-46b4-a1f8-937c1e8d35cc None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:15.900479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b7bf8219-16a0-46b4-a1f8-937c1e8d35cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:15.951727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:16.116088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf8219-16a0-46b4-a1f8-937c1e8d35cc None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:16.256933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57d538-40bb-4da6-be3b-10e7bc58b43f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7d9cfbbcd4068aa9241ffd694c631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:16.257687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d538-40bb-4da6-be3b-10e7bc58b43f service glance] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:16.258003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d538-40bb-4da6-be3b-10e7bc58b43f service glance] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:16.258278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d538-40bb-4da6-be3b-10e7bc58b43f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:16.264493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bb57d538-40bb-4da6-be3b-10e7bc58b43f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:16.417314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57d538-40bb-4da6-be3b-10e7bc58b43f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:16.419157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57d538-40bb-4da6-be3b-10e7bc58b43f service glance] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:16.448580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1043/2086] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:16.673778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:16.676146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:16.710843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960aedf-14d0-470e-b421-565a4fb53681 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:16.711140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960aedf-14d0-470e-b421-565a4fb53681 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:16.711425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960aedf-14d0-470e-b421-565a4fb53681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:16.739733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f960aedf-14d0-470e-b421-565a4fb53681 None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:16.741591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f960aedf-14d0-470e-b421-565a4fb53681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:16.837945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1044/2087] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:13:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:16.866983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d2240-792d-4a95-bb54-9e79eecaaf10 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:16.869860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960aedf-14d0-470e-b421-565a4fb53681 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:16.871926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f960aedf-14d0-470e-b421-565a4fb53681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:16.896313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:16.900660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:16.901575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:16.912377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:16.912710 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] PATH_INFO: `/v3/users/672872716ca24aed9b997c86f0c8b6c5` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:16.917042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] RBAC: Authorizing `identity:delete_user(user_id=672872716ca24aed9b997c86f0c8b6c5)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:16.919832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:17.024918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672872716ca24aed9b997c86f0c8b6c5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.031722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960aedf-14d0-470e-b421-565a4fb53681 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:17.037159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672872716ca24aed9b997c86f0c8b6c5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.037999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672872716ca24aed9b997c86f0c8b6c5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.039320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:17.040267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:17.040946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:17.041387 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:17.043748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:17.056602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672872716ca24aed9b997c86f0c8b6c5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.056946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-452f411e-b08a-4cfd-bbf3-abf33c0d49de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672872716ca24aed9b997c86f0c8b6c5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.058447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:17.060341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:17.072957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1045/2088] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:13:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:13:17.075843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:17.077708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:17.091951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1044/2089] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:16 2022] DELETE /identity/v3/users/672872716ca24aed9b997c86f0c8b6c5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:17.095719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e912f43-ebb6-44f5-8262-e30c0e9141f1 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:17.096101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e912f43-ebb6-44f5-8262-e30c0e9141f1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:17.096385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e912f43-ebb6-44f5-8262-e30c0e9141f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:17.100459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a657df-99a7-46ea-91fa-595af99a43c7 service swift] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:17.131015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4e912f43-ebb6-44f5-8262-e30c0e9141f1 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:17.132892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4e912f43-ebb6-44f5-8262-e30c0e9141f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:17.217530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:17.240836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:17.241567 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:17.241854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:17.242133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] PATH_INFO: `/v3/users/bb4c7ad91bc449f9910d4c4d0327ba71` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:17.250069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4c7ad91bc449f9910d4c4d0327ba71)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:17.254223 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:17.304601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1045/2090] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:17.306820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e912f43-ebb6-44f5-8262-e30c0e9141f1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:17.311234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4e912f43-ebb6-44f5-8262-e30c0e9141f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:17.340375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e912f43-ebb6-44f5-8262-e30c0e9141f1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:17.349799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4c7ad91bc449f9910d4c4d0327ba71'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.351340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:17.352266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:17.352551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:17.352843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] PATH_INFO: `/v3/projects/d093b9a5d4a94556980bef58a9279ab6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:17.354043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d093b9a5d4a94556980bef58a9279ab6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:17.356144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:17.363224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4c7ad91bc449f9910d4c4d0327ba71'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.410751 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4c7ad91bc449f9910d4c4d0327ba71'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.412782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4c7ad91bc449f9910d4c4d0327ba71'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.415171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4c7ad91bc449f9910d4c4d0327ba71'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.447634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd093b9a5d4a94556980bef58a9279ab6', 'request_id': 'req-175e52d7-2984-435e-9ef6-50220fbbe1c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.451524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1046/2091] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:17 2022] DELETE /identity/v3/users/bb4c7ad91bc449f9910d4c4d0327ba71 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:17.453954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:17.458168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:17.460641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd093b9a5d4a94556980bef58a9279ab6', 'request_id': 'req-175e52d7-2984-435e-9ef6-50220fbbe1c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.472926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd093b9a5d4a94556980bef58a9279ab6', 'request_id': 'req-175e52d7-2984-435e-9ef6-50220fbbe1c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.493887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] The token cache is being invalidate because project d093b9a5d4a94556980bef58a9279ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:17.494193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.496267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:17.497943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1046/2092] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:17 2022] DELETE /identity/v3/projects/d093b9a5d4a94556980bef58a9279ab6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:17.503048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:17.511388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:17.537355 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:17.606945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade047-827a-4684-942c-9cf59216793a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:17.621608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:17.622904 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:17.623467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:17.624265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:17.626932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:17.665959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e52d7-2984-435e-9ef6-50220fbbe1c8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:17.762114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:17.763938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:17.778039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1047/2093] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:17.836359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:17.839646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:17.839813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:17.840225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] PATH_INFO: `/v3/users/098838f5ab4545f4a0e071481ca13fca` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:17.842609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] RBAC: Authorizing `identity:delete_user(user_id=098838f5ab4545f4a0e071481ca13fca)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:17.846227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:17.851483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:17.902747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:17.904749 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:17.946802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c4525-20c9-4b5f-abb5-1c9df3a7d6af service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:17.958333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:17.961512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:17.961811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:17.962093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] PATH_INFO: `/v3/projects/fc5a6c97a38c4e28908047a28e066d25` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:17.963539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5a6c97a38c4e28908047a28e066d25)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:17.966490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:18.000725 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098838f5ab4545f4a0e071481ca13fca'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.036181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098838f5ab4545f4a0e071481ca13fca'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.036970 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098838f5ab4545f4a0e071481ca13fca'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.080562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098838f5ab4545f4a0e071481ca13fca'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.083126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0b655983-fc0c-4f00-9f10-5e56acac063a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098838f5ab4545f4a0e071481ca13fca'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.098491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5a6c97a38c4e28908047a28e066d25', 'request_id': 'req-0d1add69-3081-4f49-8bbf-aa00f8a7d384'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.111334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5a6c97a38c4e28908047a28e066d25', 'request_id': 'req-0d1add69-3081-4f49-8bbf-aa00f8a7d384'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.127601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1047/2094] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:17 2022] DELETE /identity/v3/users/098838f5ab4545f4a0e071481ca13fca => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:18.146239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5a6c97a38c4e28908047a28e066d25', 'request_id': 'req-0d1add69-3081-4f49-8bbf-aa00f8a7d384'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.172618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] The token cache is being invalidate because project fc5a6c97a38c4e28908047a28e066d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:18.172975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.173658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d1add69-3081-4f49-8bbf-aa00f8a7d384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:18.179065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1048/2095] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:17 2022] DELETE /identity/v3/projects/fc5a6c97a38c4e28908047a28e066d25 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:18.184013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727a93-8df7-4032-bf17-a6c9f7ba0c0e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:18.184313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727a93-8df7-4032-bf17-a6c9f7ba0c0e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:18.184603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727a93-8df7-4032-bf17-a6c9f7ba0c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:18.217848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1e727a93-8df7-4032-bf17-a6c9f7ba0c0e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:18.223494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1e727a93-8df7-4032-bf17-a6c9f7ba0c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:18.376426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1048/2096] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:18.380628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deeb9d8-8f88-4d14-9718-87a3f8a5cc37 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:18.380937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deeb9d8-8f88-4d14-9718-87a3f8a5cc37 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:18.381239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deeb9d8-8f88-4d14-9718-87a3f8a5cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:18.443941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1deeb9d8-8f88-4d14-9718-87a3f8a5cc37 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:18.445471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1deeb9d8-8f88-4d14-9718-87a3f8a5cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:18.510268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1049/2097] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:18.514424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727a93-8df7-4032-bf17-a6c9f7ba0c0e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:18.531941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727a93-8df7-4032-bf17-a6c9f7ba0c0e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:18.541926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a04fa-acf8-4744-82ad-a01b866c9d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:18.543227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a04fa-acf8-4744-82ad-a01b866c9d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:18.543717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a04fa-acf8-4744-82ad-a01b866c9d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:18.544230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a04fa-acf8-4744-82ad-a01b866c9d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:18.546602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a04fa-acf8-4744-82ad-a01b866c9d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:18.546602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a04fa-acf8-4744-82ad-a01b866c9d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:18.548526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a04fa-acf8-4744-82ad-a01b866c9d5f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:18.565003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1049/2098] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:13:18.569108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deeb9d8-8f88-4d14-9718-87a3f8a5cc37 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:18.583041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deeb9d8-8f88-4d14-9718-87a3f8a5cc37 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:18.589558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00c6bd-8125-488b-89f6-09699094b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:18.590727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c6bd-8125-488b-89f6-09699094b9de admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:18.592405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c6bd-8125-488b-89f6-09699094b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:18.592918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c6bd-8125-488b-89f6-09699094b9de admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:18.594467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00c6bd-8125-488b-89f6-09699094b9de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:18.596989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00c6bd-8125-488b-89f6-09699094b9de admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:18.663715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1050/2099] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:18 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:18.669523 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a04fa-acf8-4744-82ad-a01b866c9d5f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:18.687851 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a04fa-acf8-4744-82ad-a01b866c9d5f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:18.698861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00c6bd-8125-488b-89f6-09699094b9de admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:18.700908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3a00c6bd-8125-488b-89f6-09699094b9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:18.793584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:18.851426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde8662-0727-46b7-a2de-d43cbaccbccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:18.852605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde8662-0727-46b7-a2de-d43cbaccbccd admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:18.852842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde8662-0727-46b7-a2de-d43cbaccbccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:18.853206 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde8662-0727-46b7-a2de-d43cbaccbccd admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:18.854019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde8662-0727-46b7-a2de-d43cbaccbccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:18.857473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde8662-0727-46b7-a2de-d43cbaccbccd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:18.863523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00c6bd-8125-488b-89f6-09699094b9de admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:18.869901 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:18.870798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:18.871347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:18.871787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:18.877090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:18.883037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:18.892101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1050/2100] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:18 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:18.893288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde8662-0727-46b7-a2de-d43cbaccbccd admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:18.897005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2fde8662-0727-46b7-a2de-d43cbaccbccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:18.915240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde8662-0727-46b7-a2de-d43cbaccbccd admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:18.920981 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:18.922217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:18.922630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:18.923016 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] PATH_INFO: `/v3/projects/bee90a5bc6d84a2983b313a5ca95adbf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:18.924422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee90a5bc6d84a2983b313a5ca95adbf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:18.927660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:18.977947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:18.979788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:19.000346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee90a5bc6d84a2983b313a5ca95adbf', 'request_id': 'req-68233bf2-9d69-4686-8a98-0e70e50343b9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.010840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee90a5bc6d84a2983b313a5ca95adbf', 'request_id': 'req-68233bf2-9d69-4686-8a98-0e70e50343b9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.011352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1051/2101] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:19.017071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:19.018188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee90a5bc6d84a2983b313a5ca95adbf', 'request_id': 'req-68233bf2-9d69-4686-8a98-0e70e50343b9'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.026196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:19.040829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] The token cache is being invalidate because project bee90a5bc6d84a2983b313a5ca95adbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:19.041388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.042955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.048609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1051/2102] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:18 2022] DELETE /identity/v3/projects/bee90a5bc6d84a2983b313a5ca95adbf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:19.048609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:19.048897 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:19.057410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29ba38-1a30-4dfa-9700-3438216fbce0 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:19.162502 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68233bf2-9d69-4686-8a98-0e70e50343b9 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:19.168303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd5cd-e802-4298-b652-37d6580878b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:19.169002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd5cd-e802-4298-b652-37d6580878b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:19.169287 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd5cd-e802-4298-b652-37d6580878b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:19.169661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd5cd-e802-4298-b652-37d6580878b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:19.170320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd5cd-e802-4298-b652-37d6580878b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:19.172302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd5cd-e802-4298-b652-37d6580878b0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:19.186269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:19.187757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:19.191478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1052/2103] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:19.191478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd5cd-e802-4298-b652-37d6580878b0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:19.192659 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:19.193899 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] PATH_INFO: `/v3/projects/7cc29ad6d70c474f951c0b8ce07370ab` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:19.198147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc29ad6d70c474f951c0b8ce07370ab)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:19.200839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:19.205901 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3c1cd5cd-e802-4298-b652-37d6580878b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:19.250355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd5cd-e802-4298-b652-37d6580878b0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:19.270583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:19.271730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:19.273438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:19.275065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] PATH_INFO: `/v3/users/6f720aae8f264d939e278efd509ec2d6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:19.278457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f720aae8f264d939e278efd509ec2d6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:19.284504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:19.317183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc29ad6d70c474f951c0b8ce07370ab', 'request_id': 'req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.352759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc29ad6d70c474f951c0b8ce07370ab', 'request_id': 'req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.382436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc29ad6d70c474f951c0b8ce07370ab', 'request_id': 'req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.403661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] The token cache is being invalidate because project 7cc29ad6d70c474f951c0b8ce07370ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:19.404502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.404849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.418621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1052/2104] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:19 2022] DELETE /identity/v3/projects/7cc29ad6d70c474f951c0b8ce07370ab => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:19.422156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:19.423069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:19.423555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f720aae8f264d939e278efd509ec2d6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.444356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f720aae8f264d939e278efd509ec2d6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.445318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:19.445453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f720aae8f264d939e278efd509ec2d6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.476749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f720aae8f264d939e278efd509ec2d6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.478859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-41dfa404-6300-4744-96cb-28071148b73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f720aae8f264d939e278efd509ec2d6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:19.484260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:19.515574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1053/2105] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:19 2022] DELETE /identity/v3/users/6f720aae8f264d939e278efd509ec2d6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:19.530831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d3a8-ecba-4c96-a39f-0bed8dfdc72a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:19.536551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d3a8-ecba-4c96-a39f-0bed8dfdc72a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:19.536963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d3a8-ecba-4c96-a39f-0bed8dfdc72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:19.599263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20af62-4fbd-4a28-ac6c-cd27568a4db1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:19.624077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-52e1d3a8-ecba-4c96-a39f-0bed8dfdc72a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:19.636013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-52e1d3a8-ecba-4c96-a39f-0bed8dfdc72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:19.766876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5aba8-493d-4d0c-96cd-03968c7f4a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:19.768012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5aba8-493d-4d0c-96cd-03968c7f4a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:19.768525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5aba8-493d-4d0c-96cd-03968c7f4a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:19.769740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5aba8-493d-4d0c-96cd-03968c7f4a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:19.777778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5aba8-493d-4d0c-96cd-03968c7f4a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:19.788106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5aba8-493d-4d0c-96cd-03968c7f4a1e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:19.826783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1053/2106] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:19.828956 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5aba8-493d-4d0c-96cd-03968c7f4a1e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:19.834251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-50e5aba8-493d-4d0c-96cd-03968c7f4a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:19.871979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5aba8-493d-4d0c-96cd-03968c7f4a1e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:19.879270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5d0a2-a976-4503-945f-e8332e2640b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:19.880868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5d0a2-a976-4503-945f-e8332e2640b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:19.881399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5d0a2-a976-4503-945f-e8332e2640b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:19.882329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5d0a2-a976-4503-945f-e8332e2640b1 admin admin] PATH_INFO: `/v3/projects/848acb0300cf49d9900a11cadc90f1e2/users/ac779468c83d4a32919e94efa586ecd7/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:19.889601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1054/2107] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:19.896746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beac3eb-a2f2-4e4b-b661-a86868fc0177 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:19.897315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beac3eb-a2f2-4e4b-b661-a86868fc0177 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:19.897614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beac3eb-a2f2-4e4b-b661-a86868fc0177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:19.955024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5d0a2-a976-4503-945f-e8332e2640b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848acb0300cf49d9900a11cadc90f1e2, user_id=ac779468c83d4a32919e94efa586ecd7, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:19.959639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5d0a2-a976-4503-945f-e8332e2640b1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:19.960987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-6beac3eb-a2f2-4e4b-b661-a86868fc0177 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:19.989355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6beac3eb-a2f2-4e4b-b661-a86868fc0177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:20.003106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1054/2108] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:19 2022] PUT /identity/v3/projects/848acb0300cf49d9900a11cadc90f1e2/users/ac779468c83d4a32919e94efa586ecd7/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:20.005217 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb27bdd-baf1-47e7-a12d-1704db5898bd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:20.005521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb27bdd-baf1-47e7-a12d-1704db5898bd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:20.005860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb27bdd-baf1-47e7-a12d-1704db5898bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:20.077860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ddb27bdd-baf1-47e7-a12d-1704db5898bd None None] MFA Rules not processed for user `ac779468c83d4a32919e94efa586ecd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:20.079202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ddb27bdd-baf1-47e7-a12d-1704db5898bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:20.217211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1055/2109] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:20.218386 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beac3eb-a2f2-4e4b-b661-a86868fc0177 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:20.246531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beac3eb-a2f2-4e4b-b661-a86868fc0177 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:20.271788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75375a-289c-493b-b99b-4e6ebbe2821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:20.276962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75375a-289c-493b-b99b-4e6ebbe2821f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:20.277281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75375a-289c-493b-b99b-4e6ebbe2821f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:20.277585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75375a-289c-493b-b99b-4e6ebbe2821f admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:20.278373 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75375a-289c-493b-b99b-4e6ebbe2821f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:20.278695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75375a-289c-493b-b99b-4e6ebbe2821f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:20.287341 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75375a-289c-493b-b99b-4e6ebbe2821f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:20.293705 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1055/2110] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:20.309585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb27bdd-baf1-47e7-a12d-1704db5898bd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:20.311098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ddb27bdd-baf1-47e7-a12d-1704db5898bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:20.343119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1056/2111] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:13:20.350452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75375a-289c-493b-b99b-4e6ebbe2821f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:20.365243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75375a-289c-493b-b99b-4e6ebbe2821f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:20.371262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f803-c2db-41b3-8d59-7647e2350890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:20.371998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:20.372414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f803-c2db-41b3-8d59-7647e2350890 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:20.373033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f803-c2db-41b3-8d59-7647e2350890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:20.373460 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f803-c2db-41b3-8d59-7647e2350890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:20.375030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84f803-c2db-41b3-8d59-7647e2350890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:20.377292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84f803-c2db-41b3-8d59-7647e2350890 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:20.424935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1057/2112] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:20 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:20.424935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f803-c2db-41b3-8d59-7647e2350890 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:20.424935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1f84f803-c2db-41b3-8d59-7647e2350890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:20.458580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb27bdd-baf1-47e7-a12d-1704db5898bd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:20.572098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532db95-ad20-4fc4-adba-e6c17ecd907f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:20.574250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532db95-ad20-4fc4-adba-e6c17ecd907f service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:20.574553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532db95-ad20-4fc4-adba-e6c17ecd907f service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:20.574832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532db95-ad20-4fc4-adba-e6c17ecd907f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:20.595409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:20.625468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f803-c2db-41b3-8d59-7647e2350890 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:20.635392 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:20.637597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:20.641317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:20.641989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] PATH_INFO: `/v3/projects/2b9eaa1333dd46899fd75422acce6b9d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:20.647801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9eaa1333dd46899fd75422acce6b9d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:20.650208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:20.686637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532db95-ad20-4fc4-adba-e6c17ecd907f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:20.689398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532db95-ad20-4fc4-adba-e6c17ecd907f service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:20.716454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1056/2113] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:20.722122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532db95-ad20-4fc4-adba-e6c17ecd907f service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:20.744631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532db95-ad20-4fc4-adba-e6c17ecd907f service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:20.779643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9eaa1333dd46899fd75422acce6b9d', 'request_id': 'req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:20.812833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9eaa1333dd46899fd75422acce6b9d', 'request_id': 'req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:20.850482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9eaa1333dd46899fd75422acce6b9d', 'request_id': 'req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:20.875510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] The token cache is being invalidate because project 2b9eaa1333dd46899fd75422acce6b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:20.875809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:20.877174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d0c7c00-d5cf-47a4-a852-74cd73dacc57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:20.880920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1058/2114] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:20 2022] DELETE /identity/v3/projects/2b9eaa1333dd46899fd75422acce6b9d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:20.886200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea53b3-bafb-4ac1-9e4b-5f1d938d1896 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:20.886539 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea53b3-bafb-4ac1-9e4b-5f1d938d1896 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:20.886828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea53b3-bafb-4ac1-9e4b-5f1d938d1896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:20.898246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204a126-d676-4948-ad1b-a50501bf9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:20.910119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204a126-d676-4948-ad1b-a50501bf9215 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:20.911337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204a126-d676-4948-ad1b-a50501bf9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:20.912192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204a126-d676-4948-ad1b-a50501bf9215 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:20.920965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204a126-d676-4948-ad1b-a50501bf9215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:20.921613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8aea53b3-bafb-4ac1-9e4b-5f1d938d1896 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:20.924076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8aea53b3-bafb-4ac1-9e4b-5f1d938d1896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:20.927088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204a126-d676-4948-ad1b-a50501bf9215 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:20.938217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1059/2115] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:20.947502 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06babf71-1136-4769-8851-0825110f87a3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:20.947795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06babf71-1136-4769-8851-0825110f87a3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:20.952484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06babf71-1136-4769-8851-0825110f87a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.028634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-06babf71-1136-4769-8851-0825110f87a3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:21.030563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-06babf71-1136-4769-8851-0825110f87a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:21.037816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1057/2116] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:20 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:21.039978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204a126-d676-4948-ad1b-a50501bf9215 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.046554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c204a126-d676-4948-ad1b-a50501bf9215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:21.055669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1060/2117] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:21.058611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06babf71-1136-4769-8851-0825110f87a3 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.073470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204a126-d676-4948-ad1b-a50501bf9215 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.080240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c509-2893-4371-bb88-702d7df2beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.080240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c509-2893-4371-bb88-702d7df2beb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.080554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c509-2893-4371-bb88-702d7df2beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.080783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c509-2893-4371-bb88-702d7df2beb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.081286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06babf71-1136-4769-8851-0825110f87a3 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.081571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7c509-2893-4371-bb88-702d7df2beb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.088356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7c509-2893-4371-bb88-702d7df2beb3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.108221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c65cf-05a2-4b5c-b3ab-e840d6bab83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.110198 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c65cf-05a2-4b5c-b3ab-e840d6bab83d admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.111984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c65cf-05a2-4b5c-b3ab-e840d6bab83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.112436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c65cf-05a2-4b5c-b3ab-e840d6bab83d admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.113968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c65cf-05a2-4b5c-b3ab-e840d6bab83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:21.117227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c65cf-05a2-4b5c-b3ab-e840d6bab83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.122118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c65cf-05a2-4b5c-b3ab-e840d6bab83d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.125305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1058/2118] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:21.129935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c509-2893-4371-bb88-702d7df2beb3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.149877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:21.153306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1061/2119] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:13:21.158090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c65cf-05a2-4b5c-b3ab-e840d6bab83d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.159098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c509-2893-4371-bb88-702d7df2beb3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.167076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11f1c9-0c06-4e6d-8215-a3d4b572a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.167981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f1c9-0c06-4e6d-8215-a3d4b572a4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.168274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f1c9-0c06-4e6d-8215-a3d4b572a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.169145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f1c9-0c06-4e6d-8215-a3d4b572a4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.169479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11f1c9-0c06-4e6d-8215-a3d4b572a4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.171294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11f1c9-0c06-4e6d-8215-a3d4b572a4a6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.182606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c65cf-05a2-4b5c-b3ab-e840d6bab83d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.208780 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1059/2120] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:21.209583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11f1c9-0c06-4e6d-8215-a3d4b572a4a6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.215545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec10c0-b15e-4389-885e-2d4fef0ca90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.216306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec10c0-b15e-4389-885e-2d4fef0ca90c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.216656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec10c0-b15e-4389-885e-2d4fef0ca90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.216904 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec10c0-b15e-4389-885e-2d4fef0ca90c admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.217575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec10c0-b15e-4389-885e-2d4fef0ca90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.220124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec10c0-b15e-4389-885e-2d4fef0ca90c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.264482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11f1c9-0c06-4e6d-8215-a3d4b572a4a6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.279842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1062/2121] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:21 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:21.282313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec10c0-b15e-4389-885e-2d4fef0ca90c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.296596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297fba9-26ea-4571-8bc7-ddfa746c244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.301136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297fba9-26ea-4571-8bc7-ddfa746c244e admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.301419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297fba9-26ea-4571-8bc7-ddfa746c244e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.301699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297fba9-26ea-4571-8bc7-ddfa746c244e admin admin] PATH_INFO: `/v3/projects/137084eff67149c8a62b615ff9f7a4ea/users/6d7eae84d1ac486abd9c59c5adc3b5f8/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.375039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297fba9-26ea-4571-8bc7-ddfa746c244e admin admin] RBAC: Authorizing `identity:create_grant(project_id=137084eff67149c8a62b615ff9f7a4ea, user_id=6d7eae84d1ac486abd9c59c5adc3b5f8, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.380907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297fba9-26ea-4571-8bc7-ddfa746c244e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.425000 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1060/2122] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:21 2022] PUT /identity/v3/projects/137084eff67149c8a62b615ff9f7a4ea/users/6d7eae84d1ac486abd9c59c5adc3b5f8/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:21.450607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c18ef-4004-4083-8255-bf3ec6220771 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.450715 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c18ef-4004-4083-8255-bf3ec6220771 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.450959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c18ef-4004-4083-8255-bf3ec6220771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.495474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec10c0-b15e-4389-885e-2d4fef0ca90c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.512065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-199c18ef-4004-4083-8255-bf3ec6220771 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:21.513304 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-199c18ef-4004-4083-8255-bf3ec6220771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:21.611200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:21.647240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1061/2123] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:21.654019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c98f7c-f861-4780-8009-ad26ef9ca2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.654728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c98f7c-f861-4780-8009-ad26ef9ca2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.655019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c98f7c-f861-4780-8009-ad26ef9ca2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.655302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c98f7c-f861-4780-8009-ad26ef9ca2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.656169 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c98f7c-f861-4780-8009-ad26ef9ca2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.659089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c18ef-4004-4083-8255-bf3ec6220771 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.660672 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-199c18ef-4004-4083-8255-bf3ec6220771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:21.663875 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c98f7c-f861-4780-8009-ad26ef9ca2c2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.702189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1063/2124] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:21 2022] POST /identity/v3/users => generated 294 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:21.706217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c98f7c-f861-4780-8009-ad26ef9ca2c2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.719594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c98f7c-f861-4780-8009-ad26ef9ca2c2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.728854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171fb0d-1b55-4d84-bc0e-394efe4dbae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.729682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171fb0d-1b55-4d84-bc0e-394efe4dbae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.730536 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171fb0d-1b55-4d84-bc0e-394efe4dbae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.730829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171fb0d-1b55-4d84-bc0e-394efe4dbae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.732110 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171fb0d-1b55-4d84-bc0e-394efe4dbae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.734568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171fb0d-1b55-4d84-bc0e-394efe4dbae0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.751979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1064/2125] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:21.753139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c18ef-4004-4083-8255-bf3ec6220771 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.754866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171fb0d-1b55-4d84-bc0e-394efe4dbae0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.761455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0edd7d-f4bf-44bb-bf7a-76bcac4d3448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.762207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0edd7d-f4bf-44bb-bf7a-76bcac4d3448 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.762562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0edd7d-f4bf-44bb-bf7a-76bcac4d3448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.762907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0edd7d-f4bf-44bb-bf7a-76bcac4d3448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.769721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171fb0d-1b55-4d84-bc0e-394efe4dbae0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.774651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0edd7d-f4bf-44bb-bf7a-76bcac4d3448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.776935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c85ddd-51e7-4584-8eb7-f0cb055e8a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.777178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0edd7d-f4bf-44bb-bf7a-76bcac4d3448 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.777721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c85ddd-51e7-4584-8eb7-f0cb055e8a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.778010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c85ddd-51e7-4584-8eb7-f0cb055e8a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.778285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c85ddd-51e7-4584-8eb7-f0cb055e8a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.779133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c85ddd-51e7-4584-8eb7-f0cb055e8a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.781210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c85ddd-51e7-4584-8eb7-f0cb055e8a4b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.791485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1062/2126] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:21.802340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1065/2127] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:13:21.803544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0edd7d-f4bf-44bb-bf7a-76bcac4d3448 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:21.815313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0edd7d-f4bf-44bb-bf7a-76bcac4d3448 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:21.821399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf33de5-a48e-4972-99b4-a84582401559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:21.822420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33de5-a48e-4972-99b4-a84582401559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.822761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33de5-a48e-4972-99b4-a84582401559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.823148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33de5-a48e-4972-99b4-a84582401559 admin admin] PATH_INFO: `/v3/projects/397ed6476352407b91a2273d69cdb53a/users/0c0bbb1aacc44cfd825a807a6e07d56c/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.863288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf33de5-a48e-4972-99b4-a84582401559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397ed6476352407b91a2273d69cdb53a, user_id=0c0bbb1aacc44cfd825a807a6e07d56c, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:21.866799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf33de5-a48e-4972-99b4-a84582401559 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:21.889883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1063/2128] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:21 2022] PUT /identity/v3/projects/397ed6476352407b91a2273d69cdb53a/users/0c0bbb1aacc44cfd825a807a6e07d56c/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:21.902891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92449-3ef9-4574-99c8-ff905601ebc4 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:21.903510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92449-3ef9-4574-99c8-ff905601ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:21.904448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92449-3ef9-4574-99c8-ff905601ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:21.941802 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d8f92449-3ef9-4574-99c8-ff905601ebc4 None None] MFA Rules not processed for user `0c0bbb1aacc44cfd825a807a6e07d56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:21.945002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d8f92449-3ef9-4574-99c8-ff905601ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:22.095058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1066/2129] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:22.096170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf33de5-a48e-4972-99b4-a84582401559 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:22.184404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:22.219544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf33de5-a48e-4972-99b4-a84582401559 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:22.226305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42494149-849e-473b-8020-3a2ea4ab69f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:22.227558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42494149-849e-473b-8020-3a2ea4ab69f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:22.228336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42494149-849e-473b-8020-3a2ea4ab69f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:22.228820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42494149-849e-473b-8020-3a2ea4ab69f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:22.229888 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42494149-849e-473b-8020-3a2ea4ab69f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:22.232530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42494149-849e-473b-8020-3a2ea4ab69f3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:22.275630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1064/2130] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:22 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:22.280009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f92449-3ef9-4574-99c8-ff905601ebc4 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:22.310818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f92449-3ef9-4574-99c8-ff905601ebc4 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:22.457722 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6688d9c-e735-4506-8d79-62e456841992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:22.458523 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6688d9c-e735-4506-8d79-62e456841992 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:22.458869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6688d9c-e735-4506-8d79-62e456841992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:22.459216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6688d9c-e735-4506-8d79-62e456841992 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:22.460027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6688d9c-e735-4506-8d79-62e456841992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:22.462167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6688d9c-e735-4506-8d79-62e456841992 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:22.496029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1067/2131] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:22 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:22.499593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42494149-849e-473b-8020-3a2ea4ab69f3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:22.516565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42494149-849e-473b-8020-3a2ea4ab69f3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:22.526569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91250c47-4e7a-456e-aa55-74823b266fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:22.527498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91250c47-4e7a-456e-aa55-74823b266fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:22.527788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91250c47-4e7a-456e-aa55-74823b266fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:22.528236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91250c47-4e7a-456e-aa55-74823b266fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:22.529041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91250c47-4e7a-456e-aa55-74823b266fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:22.530701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91250c47-4e7a-456e-aa55-74823b266fb2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:22.551087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1065/2132] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:22.554731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6688d9c-e735-4506-8d79-62e456841992 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:22.567650 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6688d9c-e735-4506-8d79-62e456841992 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:22.573133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a6c0-3adc-4cde-b20a-1549b1a62d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:22.574218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a6c0-3adc-4cde-b20a-1549b1a62d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:22.574518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a6c0-3adc-4cde-b20a-1549b1a62d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:22.574818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a6c0-3adc-4cde-b20a-1549b1a62d6e admin admin] PATH_INFO: `/v3/projects/5a8909931cb14db593b608ff4b0b3cca/users/f88f0a2fb2a94d639d4e1641d61f37b6/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:22.602313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156a6c0-3adc-4cde-b20a-1549b1a62d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8909931cb14db593b608ff4b0b3cca, user_id=f88f0a2fb2a94d639d4e1641d61f37b6, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:22.606065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156a6c0-3adc-4cde-b20a-1549b1a62d6e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:22.627639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1068/2133] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:22 2022] PUT /identity/v3/projects/5a8909931cb14db593b608ff4b0b3cca/users/f88f0a2fb2a94d639d4e1641d61f37b6/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:22.632313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91250c47-4e7a-456e-aa55-74823b266fb2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:22.642791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91250c47-4e7a-456e-aa55-74823b266fb2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:22.767686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b2f38-7eaa-4208-8650-9811e238be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:22.769287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b2f38-7eaa-4208-8650-9811e238be45 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:22.769809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b2f38-7eaa-4208-8650-9811e238be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:22.770199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b2f38-7eaa-4208-8650-9811e238be45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:22.771018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b2f38-7eaa-4208-8650-9811e238be45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:22.774015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b2f38-7eaa-4208-8650-9811e238be45 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:22.812854 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a6c0-3adc-4cde-b20a-1549b1a62d6e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:22.813228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1066/2134] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:22.850356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a6c0-3adc-4cde-b20a-1549b1a62d6e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:22.891431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c6a4b-6c3c-4a6f-897c-b7ddb77457f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:22.896324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c6a4b-6c3c-4a6f-897c-b7ddb77457f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:22.896596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c6a4b-6c3c-4a6f-897c-b7ddb77457f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:22.896834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c6a4b-6c3c-4a6f-897c-b7ddb77457f0 admin admin] PATH_INFO: `/v3/projects/5a8909931cb14db593b608ff4b0b3cca/users/f88f0a2fb2a94d639d4e1641d61f37b6/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:22.908878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c6a4b-6c3c-4a6f-897c-b7ddb77457f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8909931cb14db593b608ff4b0b3cca, user_id=f88f0a2fb2a94d639d4e1641d61f37b6, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:22.917501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c6a4b-6c3c-4a6f-897c-b7ddb77457f0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:22.924545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:22.943288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1069/2135] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:22 2022] PUT /identity/v3/projects/5a8909931cb14db593b608ff4b0b3cca/users/f88f0a2fb2a94d639d4e1641d61f37b6/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:22.957565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafcb56-956a-4654-9b1f-4263abb6303c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:22.957861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafcb56-956a-4654-9b1f-4263abb6303c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:22.958143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafcb56-956a-4654-9b1f-4263abb6303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:23.011305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-dbafcb56-956a-4654-9b1f-4263abb6303c None None] MFA Rules not processed for user `f88f0a2fb2a94d639d4e1641d61f37b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:23.013195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dbafcb56-956a-4654-9b1f-4263abb6303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:23.172748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1067/2136] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:23.198020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c6a4b-6c3c-4a6f-897c-b7ddb77457f0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:23.201948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-961c6a4b-6c3c-4a6f-897c-b7ddb77457f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:23.349276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c6a4b-6c3c-4a6f-897c-b7ddb77457f0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:23.354707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212fa64-0b44-4bd4-a85c-2a655315b4f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:23.354922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212fa64-0b44-4bd4-a85c-2a655315b4f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:23.355537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212fa64-0b44-4bd4-a85c-2a655315b4f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:23.356886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212fa64-0b44-4bd4-a85c-2a655315b4f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:23.369989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212fa64-0b44-4bd4-a85c-2a655315b4f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:23.371962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212fa64-0b44-4bd4-a85c-2a655315b4f9 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:23.387996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1070/2137] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:23.464949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafcb56-956a-4654-9b1f-4263abb6303c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:23.521399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ecfab-7cb9-4c62-9827-d87654a96c0f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:23.521845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ecfab-7cb9-4c62-9827-d87654a96c0f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:23.522811 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ecfab-7cb9-4c62-9827-d87654a96c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:23.582565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a32ecfab-7cb9-4c62-9827-d87654a96c0f None None] MFA Rules not processed for user `6d7eae84d1ac486abd9c59c5adc3b5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:23.584426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a32ecfab-7cb9-4c62-9827-d87654a96c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:23.602471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:23.634426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafcb56-956a-4654-9b1f-4263abb6303c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:23.644514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:23.648067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:23.648649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:23.649095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] PATH_INFO: `/v3/users/0c0bbb1aacc44cfd825a807a6e07d56c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:23.651521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0bbb1aacc44cfd825a807a6e07d56c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:23.654701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:23.759942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1071/2138] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:23.768274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0bbb1aacc44cfd825a807a6e07d56c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:23.773403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ecfab-7cb9-4c62-9827-d87654a96c0f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:23.775181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a32ecfab-7cb9-4c62-9827-d87654a96c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:23.792855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0bbb1aacc44cfd825a807a6e07d56c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:23.800999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ecfab-7cb9-4c62-9827-d87654a96c0f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:23.813572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465c272-62b1-47c5-962a-2a1801c054a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:23.814509 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465c272-62b1-47c5-962a-2a1801c054a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:23.814786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465c272-62b1-47c5-962a-2a1801c054a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:23.815069 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465c272-62b1-47c5-962a-2a1801c054a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:23.819928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0bbb1aacc44cfd825a807a6e07d56c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:23.820667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0bbb1aacc44cfd825a807a6e07d56c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:23.822177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0d593ccb-f3b1-44ef-b6ca-bac93e2ade8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0bbb1aacc44cfd825a807a6e07d56c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:23.839093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465c272-62b1-47c5-962a-2a1801c054a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:23.841068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465c272-62b1-47c5-962a-2a1801c054a2 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:23.842325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1068/2139] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:23 2022] DELETE /identity/v3/users/0c0bbb1aacc44cfd825a807a6e07d56c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:23.847892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc754f0-d2b8-4408-8ee3-3bd0254461af None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:23.848316 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc754f0-d2b8-4408-8ee3-3bd0254461af None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:23.848759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc754f0-d2b8-4408-8ee3-3bd0254461af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:23.871660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1072/2140] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:23.884820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-dbc754f0-d2b8-4408-8ee3-3bd0254461af None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:23.886809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dbc754f0-d2b8-4408-8ee3-3bd0254461af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:24.019145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1069/2141] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:24.032084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465c272-62b1-47c5-962a-2a1801c054a2 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:24.131768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465c272-62b1-47c5-962a-2a1801c054a2 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:24.205900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:24.248627 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0699a-8019-431f-9368-373c99e3d1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:24.249256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0699a-8019-431f-9368-373c99e3d1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:24.250067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0699a-8019-431f-9368-373c99e3d1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:24.251869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0699a-8019-431f-9368-373c99e3d1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:24.275296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0699a-8019-431f-9368-373c99e3d1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:24.276682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0699a-8019-431f-9368-373c99e3d1d7 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:24.292894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1073/2142] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:24.741031 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc754f0-d2b8-4408-8ee3-3bd0254461af None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:24.742103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-dbc754f0-d2b8-4408-8ee3-3bd0254461af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:24.763135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc754f0-d2b8-4408-8ee3-3bd0254461af None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:24.771349 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:24.773180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:24.773865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:24.774086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] PATH_INFO: `/v3/projects/397ed6476352407b91a2273d69cdb53a` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:24.776171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397ed6476352407b91a2273d69cdb53a)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:24.779236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:24.875030 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397ed6476352407b91a2273d69cdb53a', 'request_id': 'req-d64e67a2-d395-4464-9a57-04f4ec429864'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:24.889005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397ed6476352407b91a2273d69cdb53a', 'request_id': 'req-d64e67a2-d395-4464-9a57-04f4ec429864'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:24.895138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:24.922977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397ed6476352407b91a2273d69cdb53a', 'request_id': 'req-d64e67a2-d395-4464-9a57-04f4ec429864'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:24.940234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] The token cache is being invalidate because project 397ed6476352407b91a2273d69cdb53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:24.941262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:24.942180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d64e67a2-d395-4464-9a57-04f4ec429864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:24.947525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1070/2143] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:24 2022] DELETE /identity/v3/projects/397ed6476352407b91a2273d69cdb53a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:24.951393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0699a-8019-431f-9368-373c99e3d1d7 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:24.965271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0699a-8019-431f-9368-373c99e3d1d7 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:25.045257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:25.046142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:25.046428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:25.046714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] PATH_INFO: `/v3/users/f88f0a2fb2a94d639d4e1641d61f37b6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:25.047952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88f0a2fb2a94d639d4e1641d61f37b6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:25.050136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:25.145232 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88f0a2fb2a94d639d4e1641d61f37b6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:25.155094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88f0a2fb2a94d639d4e1641d61f37b6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:25.156013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88f0a2fb2a94d639d4e1641d61f37b6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:25.178009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88f0a2fb2a94d639d4e1641d61f37b6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:25.179517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88f0a2fb2a94d639d4e1641d61f37b6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:25.195296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1074/2144] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:24 2022] DELETE /identity/v3/users/f88f0a2fb2a94d639d4e1641d61f37b6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:25.526255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17524a-385c-435f-ae68-2c7e45c54cb9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:25.526639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17524a-385c-435f-ae68-2c7e45c54cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:25.526973 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17524a-385c-435f-ae68-2c7e45c54cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:25.577929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8a17524a-385c-435f-ae68-2c7e45c54cb9 None None] MFA Rules not processed for user `6d7eae84d1ac486abd9c59c5adc3b5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:25.579157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8a17524a-385c-435f-ae68-2c7e45c54cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:25.660684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1071/2145] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:26.078759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:26.080803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:26.172945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:26.199189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0d65-5c5e-4b6c-bd28-f47d2f3fd525 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:26.204862 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:26.205736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:26.206052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:26.206459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] PATH_INFO: `/v3/projects/5a8909931cb14db593b608ff4b0b3cca` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:26.207924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8909931cb14db593b608ff4b0b3cca)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:26.209989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:26.311418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8909931cb14db593b608ff4b0b3cca', 'request_id': 'req-82509b67-eaee-42a9-bad9-2d105a7747cf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:26.319552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8909931cb14db593b608ff4b0b3cca', 'request_id': 'req-82509b67-eaee-42a9-bad9-2d105a7747cf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:26.327200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8909931cb14db593b608ff4b0b3cca', 'request_id': 'req-82509b67-eaee-42a9-bad9-2d105a7747cf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:26.351355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] The token cache is being invalidate because project 5a8909931cb14db593b608ff4b0b3cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:26.351869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:26.352639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-82509b67-eaee-42a9-bad9-2d105a7747cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:26.357968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1075/2146] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:26 2022] DELETE /identity/v3/projects/5a8909931cb14db593b608ff4b0b3cca => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:26.359350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61cd1e-92b9-49f1-8493-dc8c39f21d21 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:26.359862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61cd1e-92b9-49f1-8493-dc8c39f21d21 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:26.359975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61cd1e-92b9-49f1-8493-dc8c39f21d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:26.383817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bf61cd1e-92b9-49f1-8493-dc8c39f21d21 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:26.385376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bf61cd1e-92b9-49f1-8493-dc8c39f21d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:26.498340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1072/2147] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:26.506103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee6c91-9047-4033-9eb9-0d9555bbcbcb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:26.506412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee6c91-9047-4033-9eb9-0d9555bbcbcb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:26.506700 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee6c91-9047-4033-9eb9-0d9555bbcbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:26.531140 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9eee6c91-9047-4033-9eb9-0d9555bbcbcb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:26.532632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9eee6c91-9047-4033-9eb9-0d9555bbcbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:26.546140 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1076/2148] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:26.546848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61cd1e-92b9-49f1-8493-dc8c39f21d21 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:26.558568 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61cd1e-92b9-49f1-8493-dc8c39f21d21 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:26.569624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c174325-d016-4ada-91b3-badf4a7d14ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:26.570455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c174325-d016-4ada-91b3-badf4a7d14ae admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:26.570859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c174325-d016-4ada-91b3-badf4a7d14ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:26.571351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c174325-d016-4ada-91b3-badf4a7d14ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:26.572244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c174325-d016-4ada-91b3-badf4a7d14ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:26.572649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c174325-d016-4ada-91b3-badf4a7d14ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:26.575114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c174325-d016-4ada-91b3-badf4a7d14ae admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:26.601558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1073/2149] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:13:26.605987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee6c91-9047-4033-9eb9-0d9555bbcbcb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:26.619195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee6c91-9047-4033-9eb9-0d9555bbcbcb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:26.625559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22421b8-72d2-4dfc-acbf-830c2f747485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:26.626835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22421b8-72d2-4dfc-acbf-830c2f747485 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:26.627486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22421b8-72d2-4dfc-acbf-830c2f747485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:26.628115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22421b8-72d2-4dfc-acbf-830c2f747485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:26.629459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22421b8-72d2-4dfc-acbf-830c2f747485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:26.631945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22421b8-72d2-4dfc-acbf-830c2f747485 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:26.708220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1077/2150] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:26 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:26.710702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c174325-d016-4ada-91b3-badf4a7d14ae admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:26.726458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c174325-d016-4ada-91b3-badf4a7d14ae admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:26.952822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2025cc-464f-4011-84e9-27a5013cbd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:26.953613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2025cc-464f-4011-84e9-27a5013cbd86 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:26.954246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2025cc-464f-4011-84e9-27a5013cbd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:26.954246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2025cc-464f-4011-84e9-27a5013cbd86 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:26.955022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2025cc-464f-4011-84e9-27a5013cbd86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:26.957372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2025cc-464f-4011-84e9-27a5013cbd86 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:26.986226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1074/2151] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:26 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:26.991313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22421b8-72d2-4dfc-acbf-830c2f747485 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:27.005559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22421b8-72d2-4dfc-acbf-830c2f747485 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:27.015987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e84e99-41f1-4b1d-a906-9ed4f9351f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:27.017706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e84e99-41f1-4b1d-a906-9ed4f9351f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:27.019113 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e84e99-41f1-4b1d-a906-9ed4f9351f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:27.023436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e84e99-41f1-4b1d-a906-9ed4f9351f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:27.024909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e84e99-41f1-4b1d-a906-9ed4f9351f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:27.026993 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e84e99-41f1-4b1d-a906-9ed4f9351f9f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:27.040092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1078/2152] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:27.044425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2025cc-464f-4011-84e9-27a5013cbd86 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:27.058504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2025cc-464f-4011-84e9-27a5013cbd86 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:27.086946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d890717-593b-4813-9cb3-d8359064fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:27.088824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890717-593b-4813-9cb3-d8359064fa14 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:27.089834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890717-593b-4813-9cb3-d8359064fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:27.091128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890717-593b-4813-9cb3-d8359064fa14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:27.094552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d890717-593b-4813-9cb3-d8359064fa14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:27.110043 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d890717-593b-4813-9cb3-d8359064fa14 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:27.118224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:27.133082 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1075/2153] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:27.137235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e84e99-41f1-4b1d-a906-9ed4f9351f9f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:27.151378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e84e99-41f1-4b1d-a906-9ed4f9351f9f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:27.157262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68d3c7-2499-4a08-a064-af64f7fe16be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:27.158670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68d3c7-2499-4a08-a064-af64f7fe16be admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:27.159736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68d3c7-2499-4a08-a064-af64f7fe16be admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:27.160366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68d3c7-2499-4a08-a064-af64f7fe16be admin admin] PATH_INFO: `/v3/projects/6c871a7a5c7e429380c6aa04fd11c4e8/users/f9f579769e964b9aa33ddfd8c6ea3ad4/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:27.180775 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68d3c7-2499-4a08-a064-af64f7fe16be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c871a7a5c7e429380c6aa04fd11c4e8, user_id=f9f579769e964b9aa33ddfd8c6ea3ad4, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:27.183451 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68d3c7-2499-4a08-a064-af64f7fe16be admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:27.206018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1079/2154] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:27 2022] PUT /identity/v3/projects/6c871a7a5c7e429380c6aa04fd11c4e8/users/f9f579769e964b9aa33ddfd8c6ea3ad4/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:27.219601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4b74-ef74-4e99-96b1-2cec1ce864fa None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:27.220208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4b74-ef74-4e99-96b1-2cec1ce864fa None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:27.220565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4b74-ef74-4e99-96b1-2cec1ce864fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:27.274809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-00bb4b74-ef74-4e99-96b1-2cec1ce864fa None None] MFA Rules not processed for user `f9f579769e964b9aa33ddfd8c6ea3ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:27.293939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-00bb4b74-ef74-4e99-96b1-2cec1ce864fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:27.432706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1076/2155] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:27.442461 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68d3c7-2499-4a08-a064-af64f7fe16be admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:27.549490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68d3c7-2499-4a08-a064-af64f7fe16be admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:27.556945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc53f7-345b-48d6-8216-4cddaf4e8392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:27.557732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc53f7-345b-48d6-8216-4cddaf4e8392 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:27.558670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc53f7-345b-48d6-8216-4cddaf4e8392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:27.559032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc53f7-345b-48d6-8216-4cddaf4e8392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:27.560698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc53f7-345b-48d6-8216-4cddaf4e8392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:27.561986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc53f7-345b-48d6-8216-4cddaf4e8392 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:27.605380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1080/2156] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:27 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:27.606924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4b74-ef74-4e99-96b1-2cec1ce864fa None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:27.632671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4b74-ef74-4e99-96b1-2cec1ce864fa None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:27.735339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa416dd-8a09-4b8d-a8ab-4b3f684e743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:27.736414 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa416dd-8a09-4b8d-a8ab-4b3f684e743b admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:27.736942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa416dd-8a09-4b8d-a8ab-4b3f684e743b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:27.738167 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa416dd-8a09-4b8d-a8ab-4b3f684e743b admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:27.739170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa416dd-8a09-4b8d-a8ab-4b3f684e743b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:27.741519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa416dd-8a09-4b8d-a8ab-4b3f684e743b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:27.777806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1077/2157] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:27 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:27.783155 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc53f7-345b-48d6-8216-4cddaf4e8392 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:27.798293 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:27.814568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc53f7-345b-48d6-8216-4cddaf4e8392 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:27.831170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be164a8-ccc1-4059-948d-a848e6fd0c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:27.832667 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be164a8-ccc1-4059-948d-a848e6fd0c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:27.833388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be164a8-ccc1-4059-948d-a848e6fd0c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:27.833696 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be164a8-ccc1-4059-948d-a848e6fd0c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:27.834533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be164a8-ccc1-4059-948d-a848e6fd0c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:27.836699 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be164a8-ccc1-4059-948d-a848e6fd0c21 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:27.852988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1081/2158] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:27.857416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa416dd-8a09-4b8d-a8ab-4b3f684e743b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:27.869274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa416dd-8a09-4b8d-a8ab-4b3f684e743b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:27.874069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bbefe-aee5-4cd8-b952-2c0ad2ff7683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:27.874963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bbefe-aee5-4cd8-b952-2c0ad2ff7683 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:27.875255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bbefe-aee5-4cd8-b952-2c0ad2ff7683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:27.875538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bbefe-aee5-4cd8-b952-2c0ad2ff7683 admin admin] PATH_INFO: `/v3/projects/30b0c7f4b1024892b9c4c7443fb5f5e6/users/a186fc3a97da4c13b288e90c07fdcec3/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:27.895687 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bbefe-aee5-4cd8-b952-2c0ad2ff7683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b0c7f4b1024892b9c4c7443fb5f5e6, user_id=a186fc3a97da4c13b288e90c07fdcec3, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:27.898436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bbefe-aee5-4cd8-b952-2c0ad2ff7683 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:27.916656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1078/2159] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:27 2022] PUT /identity/v3/projects/30b0c7f4b1024892b9c4c7443fb5f5e6/users/a186fc3a97da4c13b288e90c07fdcec3/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:27.920772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be164a8-ccc1-4059-948d-a848e6fd0c21 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:27.938384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be164a8-ccc1-4059-948d-a848e6fd0c21 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:28.052305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df867-6f37-41cd-a8b3-5f040a4ff9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:28.053524 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df867-6f37-41cd-a8b3-5f040a4ff9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:28.055057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df867-6f37-41cd-a8b3-5f040a4ff9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:28.055602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df867-6f37-41cd-a8b3-5f040a4ff9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:28.057509 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df867-6f37-41cd-a8b3-5f040a4ff9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:28.061144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df867-6f37-41cd-a8b3-5f040a4ff9e7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:28.088575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1082/2160] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:28.093566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bbefe-aee5-4cd8-b952-2c0ad2ff7683 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:28.158231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bbefe-aee5-4cd8-b952-2c0ad2ff7683 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:28.165177 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23e4ea-7b79-4fa1-97df-e6b42ff00db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:28.166122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23e4ea-7b79-4fa1-97df-e6b42ff00db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:28.167346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23e4ea-7b79-4fa1-97df-e6b42ff00db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:28.167642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23e4ea-7b79-4fa1-97df-e6b42ff00db5 admin admin] PATH_INFO: `/v3/projects/30b0c7f4b1024892b9c4c7443fb5f5e6/users/a186fc3a97da4c13b288e90c07fdcec3/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:28.169816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23e4ea-7b79-4fa1-97df-e6b42ff00db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b0c7f4b1024892b9c4c7443fb5f5e6, user_id=a186fc3a97da4c13b288e90c07fdcec3, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:28.177495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23e4ea-7b79-4fa1-97df-e6b42ff00db5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:28.200593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1079/2161] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:28 2022] PUT /identity/v3/projects/30b0c7f4b1024892b9c4c7443fb5f5e6/users/a186fc3a97da4c13b288e90c07fdcec3/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:28.203109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f1bcf-88fb-4791-bbde-9d7ab1bb016f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:28.203623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f1bcf-88fb-4791-bbde-9d7ab1bb016f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:28.208714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f1bcf-88fb-4791-bbde-9d7ab1bb016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:28.283043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9e0f1bcf-88fb-4791-bbde-9d7ab1bb016f None None] MFA Rules not processed for user `a186fc3a97da4c13b288e90c07fdcec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:28.285434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9e0f1bcf-88fb-4791-bbde-9d7ab1bb016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:28.395327 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1083/2162] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:28.408240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23e4ea-7b79-4fa1-97df-e6b42ff00db5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:28.411130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec23e4ea-7b79-4fa1-97df-e6b42ff00db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:28.507332 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:28.543361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23e4ea-7b79-4fa1-97df-e6b42ff00db5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:28.547792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f4897-5147-4c2e-bc7c-47eb541fe25f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:28.548648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f4897-5147-4c2e-bc7c-47eb541fe25f service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:28.549075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f4897-5147-4c2e-bc7c-47eb541fe25f service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:28.549477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f4897-5147-4c2e-bc7c-47eb541fe25f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:28.662536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f4897-5147-4c2e-bc7c-47eb541fe25f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:28.664382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f4897-5147-4c2e-bc7c-47eb541fe25f service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:28.677935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1080/2163] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:30.216626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f1bcf-88fb-4791-bbde-9d7ab1bb016f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:30.232529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f1bcf-88fb-4791-bbde-9d7ab1bb016f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:30.236962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f712533-c35d-42ae-9825-9e539c5e74b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:30.238424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f712533-c35d-42ae-9825-9e539c5e74b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:30.241090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f712533-c35d-42ae-9825-9e539c5e74b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:30.242046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f712533-c35d-42ae-9825-9e539c5e74b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:30.253950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f712533-c35d-42ae-9825-9e539c5e74b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:30.255641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f712533-c35d-42ae-9825-9e539c5e74b3 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:30.271211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1084/2164] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:31.353521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f4897-5147-4c2e-bc7c-47eb541fe25f service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:31.354981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-452f4897-5147-4c2e-bc7c-47eb541fe25f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:31.447833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f4897-5147-4c2e-bc7c-47eb541fe25f service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:31.451117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:31.452125 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:31.452502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:31.452852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] PATH_INFO: `/v3/users/ac779468c83d4a32919e94efa586ecd7` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:31.454153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac779468c83d4a32919e94efa586ecd7)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:31.456157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:31.541186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac779468c83d4a32919e94efa586ecd7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:31.556737 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac779468c83d4a32919e94efa586ecd7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:31.574857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac779468c83d4a32919e94efa586ecd7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:31.575660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac779468c83d4a32919e94efa586ecd7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:31.576410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac779468c83d4a32919e94efa586ecd7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:31.604670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1081/2165] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:31 2022] DELETE /identity/v3/users/ac779468c83d4a32919e94efa586ecd7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:31.609483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92a88c-a5db-4e65-b9d1-05fe5f571777 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:31.611092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92a88c-a5db-4e65-b9d1-05fe5f571777 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:31.611661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92a88c-a5db-4e65-b9d1-05fe5f571777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:31.636694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7d92a88c-a5db-4e65-b9d1-05fe5f571777 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:31.638004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7d92a88c-a5db-4e65-b9d1-05fe5f571777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:31.713328 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:31.727987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1085/2166] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:31.736065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:31.738275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:31.759995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:31.865134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21892dc-e1ca-4968-9d6c-16e08a3645df admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:31.870301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43543b21-cfa9-495d-a02b-1de8d932e620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:31.871061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43543b21-cfa9-495d-a02b-1de8d932e620 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:31.871422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43543b21-cfa9-495d-a02b-1de8d932e620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:31.871801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43543b21-cfa9-495d-a02b-1de8d932e620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:31.888147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43543b21-cfa9-495d-a02b-1de8d932e620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:31.895966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43543b21-cfa9-495d-a02b-1de8d932e620 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:31.906441 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1082/2167] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:32.511346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92a88c-a5db-4e65-b9d1-05fe5f571777 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:32.514681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7d92a88c-a5db-4e65-b9d1-05fe5f571777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:32.541168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92a88c-a5db-4e65-b9d1-05fe5f571777 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:32.556939 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:32.558537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:32.559134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:32.559426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] PATH_INFO: `/v3/projects/848acb0300cf49d9900a11cadc90f1e2` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:32.560735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=848acb0300cf49d9900a11cadc90f1e2)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:32.562665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:32.630872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848acb0300cf49d9900a11cadc90f1e2', 'request_id': 'req-bd1b7e52-221e-4767-b723-b4f37ea1ff64'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:32.638790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848acb0300cf49d9900a11cadc90f1e2', 'request_id': 'req-bd1b7e52-221e-4767-b723-b4f37ea1ff64'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:32.647030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848acb0300cf49d9900a11cadc90f1e2', 'request_id': 'req-bd1b7e52-221e-4767-b723-b4f37ea1ff64'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:32.673240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] The token cache is being invalidate because project 848acb0300cf49d9900a11cadc90f1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:32.673719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:32.675520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-bd1b7e52-221e-4767-b723-b4f37ea1ff64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:32.677201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1086/2168] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:32 2022] DELETE /identity/v3/projects/848acb0300cf49d9900a11cadc90f1e2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:32.693499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81feb1a-a344-4ae0-a456-adecc24fc8ff None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:32.694067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81feb1a-a344-4ae0-a456-adecc24fc8ff None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:32.694310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81feb1a-a344-4ae0-a456-adecc24fc8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:32.726428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c81feb1a-a344-4ae0-a456-adecc24fc8ff None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:32.727840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c81feb1a-a344-4ae0-a456-adecc24fc8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:32.796711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1083/2169] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:32.805224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87edc-4db9-4ddf-9786-e1500545caca None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:32.805527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87edc-4db9-4ddf-9786-e1500545caca None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:32.805796 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87edc-4db9-4ddf-9786-e1500545caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:32.829778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7fc87edc-4db9-4ddf-9786-e1500545caca None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:32.832630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7fc87edc-4db9-4ddf-9786-e1500545caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:32.840953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1087/2170] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:32.845553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81feb1a-a344-4ae0-a456-adecc24fc8ff None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:32.856729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81feb1a-a344-4ae0-a456-adecc24fc8ff None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:32.861777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e1091-07c3-45da-adc0-3f32f7223e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:32.862530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1091-07c3-45da-adc0-3f32f7223e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:32.862872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1091-07c3-45da-adc0-3f32f7223e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:32.863149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1091-07c3-45da-adc0-3f32f7223e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:32.863877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e1091-07c3-45da-adc0-3f32f7223e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:32.864201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e1091-07c3-45da-adc0-3f32f7223e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:32.865806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e1091-07c3-45da-adc0-3f32f7223e43 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:32.878743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1084/2171] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:13:32.883101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87edc-4db9-4ddf-9786-e1500545caca None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:32.892862 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87edc-4db9-4ddf-9786-e1500545caca None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:32.900290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb25bfe-88ee-40ff-8c33-f25bb35389b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:32.900967 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb25bfe-88ee-40ff-8c33-f25bb35389b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:32.901236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb25bfe-88ee-40ff-8c33-f25bb35389b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:32.901508 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb25bfe-88ee-40ff-8c33-f25bb35389b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:32.902203 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb25bfe-88ee-40ff-8c33-f25bb35389b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:32.904125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb25bfe-88ee-40ff-8c33-f25bb35389b0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:32.926531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecee4cc-8735-495b-bab7-849df5069fbd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:32.926849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecee4cc-8735-495b-bab7-849df5069fbd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:32.927227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecee4cc-8735-495b-bab7-849df5069fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:32.958385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1ecee4cc-8735-495b-bab7-849df5069fbd None None] MFA Rules not processed for user `c71e317587f6475790af1cc766215358`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:32.960008 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1ecee4cc-8735-495b-bab7-849df5069fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:32.963935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1088/2172] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:32 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:32.968879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb25bfe-88ee-40ff-8c33-f25bb35389b0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.075648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb25bfe-88ee-40ff-8c33-f25bb35389b0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.081679 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080a4de-69a2-4842-839a-17202d64826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.082676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080a4de-69a2-4842-839a-17202d64826d admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.084158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080a4de-69a2-4842-839a-17202d64826d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.084541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080a4de-69a2-4842-839a-17202d64826d admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.084919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1085/2173] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:33.085345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080a4de-69a2-4842-839a-17202d64826d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.087303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080a4de-69a2-4842-839a-17202d64826d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.129231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1089/2174] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:32 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:33.130438 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecee4cc-8735-495b-bab7-849df5069fbd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.145422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecee4cc-8735-495b-bab7-849df5069fbd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.150058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84793fe0-5393-447e-882d-089dc3125b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.150726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84793fe0-5393-447e-882d-089dc3125b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.151013 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84793fe0-5393-447e-882d-089dc3125b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.151294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84793fe0-5393-447e-882d-089dc3125b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.152470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84793fe0-5393-447e-882d-089dc3125b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.154130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84793fe0-5393-447e-882d-089dc3125b96 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.165727 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1086/2175] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:13:33.169933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080a4de-69a2-4842-839a-17202d64826d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.181636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080a4de-69a2-4842-839a-17202d64826d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.187961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52757f-aaa5-4f6d-8cb0-b0139b318ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.188681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52757f-aaa5-4f6d-8cb0-b0139b318ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.188969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52757f-aaa5-4f6d-8cb0-b0139b318ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.189249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52757f-aaa5-4f6d-8cb0-b0139b318ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.190031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52757f-aaa5-4f6d-8cb0-b0139b318ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.191698 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52757f-aaa5-4f6d-8cb0-b0139b318ad6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.203944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1090/2176] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:33.208053 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84793fe0-5393-447e-882d-089dc3125b96 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.218627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84793fe0-5393-447e-882d-089dc3125b96 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.224961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50609f7-858f-4683-842d-aecf908d8dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.225966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50609f7-858f-4683-842d-aecf908d8dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.226222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50609f7-858f-4683-842d-aecf908d8dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.227011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50609f7-858f-4683-842d-aecf908d8dd8 admin admin] PATH_INFO: `/v3/projects/9d22f7d809b9442b9e95b6f8995c5978/users/fe9e0414f59541fa8319827c34d14393/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.247215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50609f7-858f-4683-842d-aecf908d8dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d22f7d809b9442b9e95b6f8995c5978, user_id=fe9e0414f59541fa8319827c34d14393, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.250783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50609f7-858f-4683-842d-aecf908d8dd8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.266202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1087/2177] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:33 2022] PUT /identity/v3/projects/9d22f7d809b9442b9e95b6f8995c5978/users/fe9e0414f59541fa8319827c34d14393/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:33.277269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e25efa-5e70-415b-8ece-7da7beba8f74 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.277564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e25efa-5e70-415b-8ece-7da7beba8f74 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.277845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e25efa-5e70-415b-8ece-7da7beba8f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.317085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-44e25efa-5e70-415b-8ece-7da7beba8f74 None None] MFA Rules not processed for user `fe9e0414f59541fa8319827c34d14393`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:33.318553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-44e25efa-5e70-415b-8ece-7da7beba8f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:33.345834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:33.398712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1091/2178] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:33.403051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50609f7-858f-4683-842d-aecf908d8dd8 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.422608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:33.490188 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50609f7-858f-4683-842d-aecf908d8dd8 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.495128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1bbb2-0962-43a4-bbc0-5d34a7991435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.495917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1bbb2-0962-43a4-bbc0-5d34a7991435 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.496313 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1bbb2-0962-43a4-bbc0-5d34a7991435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.496689 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1bbb2-0962-43a4-bbc0-5d34a7991435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.497482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1bbb2-0962-43a4-bbc0-5d34a7991435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.499467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1bbb2-0962-43a4-bbc0-5d34a7991435 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.537222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1088/2179] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:33 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:33.538763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e25efa-5e70-415b-8ece-7da7beba8f74 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.552134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e25efa-5e70-415b-8ece-7da7beba8f74 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.620023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80965c8-99e6-47d4-baf4-755442a5534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.620735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80965c8-99e6-47d4-baf4-755442a5534a admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.621028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80965c8-99e6-47d4-baf4-755442a5534a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.621312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80965c8-99e6-47d4-baf4-755442a5534a admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.622028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80965c8-99e6-47d4-baf4-755442a5534a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.624139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80965c8-99e6-47d4-baf4-755442a5534a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.645947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1092/2180] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:33 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:33.649753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1bbb2-0962-43a4-bbc0-5d34a7991435 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.660238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1bbb2-0962-43a4-bbc0-5d34a7991435 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.665239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0b5eb-d3de-41a1-ac0e-5c91b38649d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.666104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0b5eb-d3de-41a1-ac0e-5c91b38649d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.666430 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0b5eb-d3de-41a1-ac0e-5c91b38649d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.666713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0b5eb-d3de-41a1-ac0e-5c91b38649d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.667479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0b5eb-d3de-41a1-ac0e-5c91b38649d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.669105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0b5eb-d3de-41a1-ac0e-5c91b38649d9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.681234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1089/2181] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:33.686150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80965c8-99e6-47d4-baf4-755442a5534a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.697446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80965c8-99e6-47d4-baf4-755442a5534a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.702936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab140-bed1-4a7c-aad9-5b33d28996d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.704325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab140-bed1-4a7c-aad9-5b33d28996d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.705109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab140-bed1-4a7c-aad9-5b33d28996d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.705109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab140-bed1-4a7c-aad9-5b33d28996d3 admin admin] PATH_INFO: `/v3/projects/ef53dc5e464c4af8b34ebdc12a6e3044/users/36597f2c139647f2bb6ae3463a1b85b9/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.726063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ab140-bed1-4a7c-aad9-5b33d28996d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef53dc5e464c4af8b34ebdc12a6e3044, user_id=36597f2c139647f2bb6ae3463a1b85b9, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.729426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ab140-bed1-4a7c-aad9-5b33d28996d3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.747299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1093/2182] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:33 2022] PUT /identity/v3/projects/ef53dc5e464c4af8b34ebdc12a6e3044/users/36597f2c139647f2bb6ae3463a1b85b9/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:33.751592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0b5eb-d3de-41a1-ac0e-5c91b38649d9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.773540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0b5eb-d3de-41a1-ac0e-5c91b38649d9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.840978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140e9cc-3421-4c5e-9002-42f4d8036fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.841786 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140e9cc-3421-4c5e-9002-42f4d8036fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.842079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140e9cc-3421-4c5e-9002-42f4d8036fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.842358 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140e9cc-3421-4c5e-9002-42f4d8036fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.843259 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140e9cc-3421-4c5e-9002-42f4d8036fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.845697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140e9cc-3421-4c5e-9002-42f4d8036fe0 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.863693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1090/2183] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:33.865705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab140-bed1-4a7c-aad9-5b33d28996d3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:33.881873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab140-bed1-4a7c-aad9-5b33d28996d3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:33.894732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f290ad2-ccb3-42a8-a667-30834277d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:33.895723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290ad2-ccb3-42a8-a667-30834277d05a admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.896112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290ad2-ccb3-42a8-a667-30834277d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.896658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290ad2-ccb3-42a8-a667-30834277d05a admin admin] PATH_INFO: `/v3/projects/ef53dc5e464c4af8b34ebdc12a6e3044/users/36597f2c139647f2bb6ae3463a1b85b9/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.900320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f290ad2-ccb3-42a8-a667-30834277d05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef53dc5e464c4af8b34ebdc12a6e3044, user_id=36597f2c139647f2bb6ae3463a1b85b9, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:33.905860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f290ad2-ccb3-42a8-a667-30834277d05a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:33.921843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1094/2184] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:33 2022] PUT /identity/v3/projects/ef53dc5e464c4af8b34ebdc12a6e3044/users/36597f2c139647f2bb6ae3463a1b85b9/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:33.933212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115390-47de-4c8e-ac70-5443389eed27 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:33.933583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115390-47de-4c8e-ac70-5443389eed27 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:33.933965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115390-47de-4c8e-ac70-5443389eed27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:33.965294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cc115390-47de-4c8e-ac70-5443389eed27 None None] MFA Rules not processed for user `36597f2c139647f2bb6ae3463a1b85b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:33.967123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cc115390-47de-4c8e-ac70-5443389eed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:34.066456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1091/2185] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:34.088943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f290ad2-ccb3-42a8-a667-30834277d05a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:34.090795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1f290ad2-ccb3-42a8-a667-30834277d05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:34.171759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f290ad2-ccb3-42a8-a667-30834277d05a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:34.178719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30652b-3e05-4fe8-9308-7afb52d3357a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:34.180645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30652b-3e05-4fe8-9308-7afb52d3357a service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:34.181380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30652b-3e05-4fe8-9308-7afb52d3357a service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:34.181825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30652b-3e05-4fe8-9308-7afb52d3357a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:34.195886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30652b-3e05-4fe8-9308-7afb52d3357a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:34.198495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30652b-3e05-4fe8-9308-7afb52d3357a service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:34.232223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1095/2186] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:34.321653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115390-47de-4c8e-ac70-5443389eed27 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:34.323141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cc115390-47de-4c8e-ac70-5443389eed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:34.336371 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:34.347416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30652b-3e05-4fe8-9308-7afb52d3357a service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:34.356412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30652b-3e05-4fe8-9308-7afb52d3357a service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:34.360372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004e8c7-2a9b-45e8-9c47-14e45cb41ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:34.361091 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e8c7-2a9b-45e8-9c47-14e45cb41ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:34.361446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e8c7-2a9b-45e8-9c47-14e45cb41ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:34.361795 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e8c7-2a9b-45e8-9c47-14e45cb41ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:34.376318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:34.409704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115390-47de-4c8e-ac70-5443389eed27 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:34.415755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:34.417178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:34.417475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:34.417765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] PATH_INFO: `/v3/users/f9f579769e964b9aa33ddfd8c6ea3ad4` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:34.419135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f579769e964b9aa33ddfd8c6ea3ad4)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:34.421458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:34.430012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004e8c7-2a9b-45e8-9c47-14e45cb41ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:34.431466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004e8c7-2a9b-45e8-9c47-14e45cb41ef8 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:34.445164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1096/2187] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:34.493963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f579769e964b9aa33ddfd8c6ea3ad4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.504126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f579769e964b9aa33ddfd8c6ea3ad4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.523063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f579769e964b9aa33ddfd8c6ea3ad4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.523880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f579769e964b9aa33ddfd8c6ea3ad4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.524692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f579769e964b9aa33ddfd8c6ea3ad4'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.547449 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1092/2188] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:34 2022] DELETE /identity/v3/users/f9f579769e964b9aa33ddfd8c6ea3ad4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:34.552960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb85f-9337-4d82-a330-4c939740fad5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:34.553434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb85f-9337-4d82-a330-4c939740fad5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:34.553761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb85f-9337-4d82-a330-4c939740fad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:34.580320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f17fb85f-9337-4d82-a330-4c939740fad5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:34.583442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f17fb85f-9337-4d82-a330-4c939740fad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:34.672063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1097/2189] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:34.679419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:34.680831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:34.741119 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482af93a-7c76-4c3b-8e1a-2cc5c703eec5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:34.745004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803588-517e-4555-8382-f38b7a00e149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:34.745646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803588-517e-4555-8382-f38b7a00e149 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:34.745936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803588-517e-4555-8382-f38b7a00e149 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:34.746239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803588-517e-4555-8382-f38b7a00e149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:34.755194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb85f-9337-4d82-a330-4c939740fad5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:34.756121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36803588-517e-4555-8382-f38b7a00e149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:34.756639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f17fb85f-9337-4d82-a330-4c939740fad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:34.757589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36803588-517e-4555-8382-f38b7a00e149 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:34.767163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1093/2190] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:34.768445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb85f-9337-4d82-a330-4c939740fad5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:34.773068 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:34.773977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:34.774280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:34.774544 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] PATH_INFO: `/v3/users/fe9e0414f59541fa8319827c34d14393` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:34.775762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9e0414f59541fa8319827c34d14393)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:34.777773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:34.828180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9e0414f59541fa8319827c34d14393'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.836464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9e0414f59541fa8319827c34d14393'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.837104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9e0414f59541fa8319827c34d14393'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.852236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9e0414f59541fa8319827c34d14393'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.853821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9e0414f59541fa8319827c34d14393'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:34.870501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1098/2191] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:34 2022] DELETE /identity/v3/users/fe9e0414f59541fa8319827c34d14393 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:34.875999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c2c32-6c60-4c2c-b7e1-5292045bacab None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:34.876765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c2c32-6c60-4c2c-b7e1-5292045bacab None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:34.877541 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c2c32-6c60-4c2c-b7e1-5292045bacab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:34.904109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-252c2c32-6c60-4c2c-b7e1-5292045bacab None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:34.905677 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-252c2c32-6c60-4c2c-b7e1-5292045bacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:34.948663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:34.989864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1094/2192] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:35.000013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:35.001864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:35.039609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:35.081219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c2c32-6c60-4c2c-b7e1-5292045bacab None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:35.082602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-252c2c32-6c60-4c2c-b7e1-5292045bacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:35.083007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfccfa8-d2a9-4e71-8e5e-12d462e133c6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:35.087652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca3476-b93d-4375-8d6b-96b3683f296e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:35.088388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca3476-b93d-4375-8d6b-96b3683f296e service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:35.088772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca3476-b93d-4375-8d6b-96b3683f296e service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:35.089151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca3476-b93d-4375-8d6b-96b3683f296e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:35.100839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c2c32-6c60-4c2c-b7e1-5292045bacab None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:35.105926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:35.106806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:35.107100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:35.107388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] PATH_INFO: `/v3/projects/6c871a7a5c7e429380c6aa04fd11c4e8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:35.112957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca3476-b93d-4375-8d6b-96b3683f296e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:35.113084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c871a7a5c7e429380c6aa04fd11c4e8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:35.114442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca3476-b93d-4375-8d6b-96b3683f296e service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:35.116380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:35.129775 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1099/2193] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:35.183584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c871a7a5c7e429380c6aa04fd11c4e8', 'request_id': 'req-0282f562-6cda-40e9-920b-86d75d50239b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.194995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c871a7a5c7e429380c6aa04fd11c4e8', 'request_id': 'req-0282f562-6cda-40e9-920b-86d75d50239b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.228853 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c871a7a5c7e429380c6aa04fd11c4e8', 'request_id': 'req-0282f562-6cda-40e9-920b-86d75d50239b'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.241893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] The token cache is being invalidate because project 6c871a7a5c7e429380c6aa04fd11c4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:35.242329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.243057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0282f562-6cda-40e9-920b-86d75d50239b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.244666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1095/2194] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:35 2022] DELETE /identity/v3/projects/6c871a7a5c7e429380c6aa04fd11c4e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:35.248769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca3476-b93d-4375-8d6b-96b3683f296e service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:35.264890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca3476-b93d-4375-8d6b-96b3683f296e service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:35.438438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:35.439411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:35.440205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:35.442179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] PATH_INFO: `/v3/users/a186fc3a97da4c13b288e90c07fdcec3` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:35.444187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a186fc3a97da4c13b288e90c07fdcec3)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:35.446455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:35.525951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a186fc3a97da4c13b288e90c07fdcec3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.538381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a186fc3a97da4c13b288e90c07fdcec3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.539307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a186fc3a97da4c13b288e90c07fdcec3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.562665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a186fc3a97da4c13b288e90c07fdcec3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.563431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a186fc3a97da4c13b288e90c07fdcec3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:35.584312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1100/2195] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:35 2022] DELETE /identity/v3/users/a186fc3a97da4c13b288e90c07fdcec3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:35.590818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654ba57-d98e-42f9-9db6-50a786763d7c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:35.590818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654ba57-d98e-42f9-9db6-50a786763d7c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:35.590818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654ba57-d98e-42f9-9db6-50a786763d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:35.646493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2654ba57-d98e-42f9-9db6-50a786763d7c None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:35.650960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2654ba57-d98e-42f9-9db6-50a786763d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:35.720525 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:35.723829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:35.787929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1096/2196] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:13:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:35.798965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654ba57-d98e-42f9-9db6-50a786763d7c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:35.800842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2654ba57-d98e-42f9-9db6-50a786763d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:35.845077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:35.879382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:35.881160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0faa8-2d02-4f80-9b14-fedda5d383c3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:35.892849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:35.894477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:35.894765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:35.895049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] PATH_INFO: `/v3/projects/9d22f7d809b9442b9e95b6f8995c5978` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:35.896812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654ba57-d98e-42f9-9db6-50a786763d7c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:35.898518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d22f7d809b9442b9e95b6f8995c5978)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:35.900817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:35.910196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da7c78-4477-4b85-8e93-298f3fd38607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:35.910872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da7c78-4477-4b85-8e93-298f3fd38607 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:35.911154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da7c78-4477-4b85-8e93-298f3fd38607 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:35.912006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da7c78-4477-4b85-8e93-298f3fd38607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:35.927420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da7c78-4477-4b85-8e93-298f3fd38607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:35.930039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da7c78-4477-4b85-8e93-298f3fd38607 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:35.949860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1097/2197] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:13:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 22:13:36.024064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d22f7d809b9442b9e95b6f8995c5978', 'request_id': 'req-5087d459-1478-41be-a564-c43e08b5c9a6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.030990 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d22f7d809b9442b9e95b6f8995c5978', 'request_id': 'req-5087d459-1478-41be-a564-c43e08b5c9a6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.038902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d22f7d809b9442b9e95b6f8995c5978', 'request_id': 'req-5087d459-1478-41be-a564-c43e08b5c9a6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.058516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] The token cache is being invalidate because project 9d22f7d809b9442b9e95b6f8995c5978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:36.058832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.059483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.063491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1101/2198] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:35 2022] DELETE /identity/v3/projects/9d22f7d809b9442b9e95b6f8995c5978 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:36.068707 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da7c78-4477-4b85-8e93-298f3fd38607 service swift] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:36.082793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da7c78-4477-4b85-8e93-298f3fd38607 service swift] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:36.199250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:36.200478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:36.200954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:36.201457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] PATH_INFO: `/v3/users/36597f2c139647f2bb6ae3463a1b85b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:36.209295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36597f2c139647f2bb6ae3463a1b85b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:36.211830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:36.314941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36597f2c139647f2bb6ae3463a1b85b9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.329404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36597f2c139647f2bb6ae3463a1b85b9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.367963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36597f2c139647f2bb6ae3463a1b85b9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.368762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36597f2c139647f2bb6ae3463a1b85b9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.369396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36597f2c139647f2bb6ae3463a1b85b9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:36.394248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1098/2199] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:36 2022] DELETE /identity/v3/users/36597f2c139647f2bb6ae3463a1b85b9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:36.507631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:36.509420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:36.564632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087d459-1478-41be-a564-c43e08b5c9a6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:36.995596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:36.999381 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:37.060860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:37.067509 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:37.072023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:37.076409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] PATH_INFO: `/v3/projects/30b0c7f4b1024892b9c4c7443fb5f5e6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:37.093230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b0c7f4b1024892b9c4c7443fb5f5e6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:37.124260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:37.247584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde95ff2-9286-4b41-b62c-7234db83dba6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:37.287291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:37.291121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:37.293465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:37.294294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] PATH_INFO: `/v3/projects/ef53dc5e464c4af8b34ebdc12a6e3044` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:37.297953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef53dc5e464c4af8b34ebdc12a6e3044)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:37.303490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:37.352962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:37.437250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b0c7f4b1024892b9c4c7443fb5f5e6', 'request_id': 'req-49190d6f-6d54-4795-a0bc-c4f88155659a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.481535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b0c7f4b1024892b9c4c7443fb5f5e6', 'request_id': 'req-49190d6f-6d54-4795-a0bc-c4f88155659a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.510338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b0c7f4b1024892b9c4c7443fb5f5e6', 'request_id': 'req-49190d6f-6d54-4795-a0bc-c4f88155659a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.520350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef53dc5e464c4af8b34ebdc12a6e3044', 'request_id': 'req-4f8b7a29-239d-4f0c-a385-8112bbe979da'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.547411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] The token cache is being invalidate because project 30b0c7f4b1024892b9c4c7443fb5f5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:37.552242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.555768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-49190d6f-6d54-4795-a0bc-c4f88155659a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.556258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef53dc5e464c4af8b34ebdc12a6e3044', 'request_id': 'req-4f8b7a29-239d-4f0c-a385-8112bbe979da'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.558416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1102/2200] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:36 2022] DELETE /identity/v3/projects/30b0c7f4b1024892b9c4c7443fb5f5e6 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:37.569295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ebfe-0604-44c5-8d77-9fd1fba48bf9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:37.569863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ebfe-0604-44c5-8d77-9fd1fba48bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:37.570404 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ebfe-0604-44c5-8d77-9fd1fba48bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:37.591804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef53dc5e464c4af8b34ebdc12a6e3044', 'request_id': 'req-4f8b7a29-239d-4f0c-a385-8112bbe979da'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.638168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] The token cache is being invalidate because project ef53dc5e464c4af8b34ebdc12a6e3044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:37.638642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.639653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4f8b7a29-239d-4f0c-a385-8112bbe979da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:37.643008 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1099/2201] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:36 2022] DELETE /identity/v3/projects/ef53dc5e464c4af8b34ebdc12a6e3044 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:37.648314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7b11ebfe-0604-44c5-8d77-9fd1fba48bf9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:37.649731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e371abd-b9f5-4e42-99b4-b999682550f4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:37.650263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7b11ebfe-0604-44c5-8d77-9fd1fba48bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:37.650400 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e371abd-b9f5-4e42-99b4-b999682550f4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:37.650849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e371abd-b9f5-4e42-99b4-b999682550f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:37.680580 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:37.755464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7e371abd-b9f5-4e42-99b4-b999682550f4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:37.759506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7e371abd-b9f5-4e42-99b4-b999682550f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:37.869478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1103/2202] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:37.874331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1298f-d470-41dc-82fa-1416bd5b978c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:37.874922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1298f-d470-41dc-82fa-1416bd5b978c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:37.875918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1298f-d470-41dc-82fa-1416bd5b978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:37.938036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-77f1298f-d470-41dc-82fa-1416bd5b978c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:37.943455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-77f1298f-d470-41dc-82fa-1416bd5b978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:37.962223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1104/2203] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:37.968288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1298f-d470-41dc-82fa-1416bd5b978c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:37.992905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1298f-d470-41dc-82fa-1416bd5b978c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.007510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79629329-f951-467a-ba6d-45975a92e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.008909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79629329-f951-467a-ba6d-45975a92e792 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.009361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79629329-f951-467a-ba6d-45975a92e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.009831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79629329-f951-467a-ba6d-45975a92e792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.010928 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79629329-f951-467a-ba6d-45975a92e792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:38.013109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79629329-f951-467a-ba6d-45975a92e792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.020010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79629329-f951-467a-ba6d-45975a92e792 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.050767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1100/2204] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:38.056214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1105/2205] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:13:38.059749 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178be057-2e3f-41ad-8f4f-b7abacdbb70f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.059749 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178be057-2e3f-41ad-8f4f-b7abacdbb70f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.060050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178be057-2e3f-41ad-8f4f-b7abacdbb70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.061365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79629329-f951-467a-ba6d-45975a92e792 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.091092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79629329-f951-467a-ba6d-45975a92e792 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.107307 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-178be057-2e3f-41ad-8f4f-b7abacdbb70f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:38.107845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-178be057-2e3f-41ad-8f4f-b7abacdbb70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:38.122772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566ad4-0b2d-4f8d-a21a-dbf3461508c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.123706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566ad4-0b2d-4f8d-a21a-dbf3461508c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.124183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566ad4-0b2d-4f8d-a21a-dbf3461508c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.124618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566ad4-0b2d-4f8d-a21a-dbf3461508c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.125594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0566ad4-0b2d-4f8d-a21a-dbf3461508c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.128672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0566ad4-0b2d-4f8d-a21a-dbf3461508c8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.130154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1101/2206] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:38.131120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178be057-2e3f-41ad-8f4f-b7abacdbb70f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.158700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178be057-2e3f-41ad-8f4f-b7abacdbb70f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.167867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49b9fb-7ff5-4a1b-bb31-57c5c0591605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.168613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49b9fb-7ff5-4a1b-bb31-57c5c0591605 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.168915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49b9fb-7ff5-4a1b-bb31-57c5c0591605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.169311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49b9fb-7ff5-4a1b-bb31-57c5c0591605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.169967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49b9fb-7ff5-4a1b-bb31-57c5c0591605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:38.170417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49b9fb-7ff5-4a1b-bb31-57c5c0591605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.172162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49b9fb-7ff5-4a1b-bb31-57c5c0591605 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.181610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1106/2207] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:38 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:38.187985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566ad4-0b2d-4f8d-a21a-dbf3461508c8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.227140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1102/2208] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:13:38.233636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49b9fb-7ff5-4a1b-bb31-57c5c0591605 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.259874 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49b9fb-7ff5-4a1b-bb31-57c5c0591605 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.380144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa775c-5cf6-4dce-9613-603366b79222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.380880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa775c-5cf6-4dce-9613-603366b79222 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.381251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa775c-5cf6-4dce-9613-603366b79222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.381538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa775c-5cf6-4dce-9613-603366b79222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.382250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa775c-5cf6-4dce-9613-603366b79222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.384294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa775c-5cf6-4dce-9613-603366b79222 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.397494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566ad4-0b2d-4f8d-a21a-dbf3461508c8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.415972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec57c4-f013-44b9-9d38-3fd99f71fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.419101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec57c4-f013-44b9-9d38-3fd99f71fd2c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.419810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec57c4-f013-44b9-9d38-3fd99f71fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.420512 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec57c4-f013-44b9-9d38-3fd99f71fd2c admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.422497 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec57c4-f013-44b9-9d38-3fd99f71fd2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.427575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec57c4-f013-44b9-9d38-3fd99f71fd2c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.461277 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1103/2209] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:38 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:38.462480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa775c-5cf6-4dce-9613-603366b79222 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.473547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1107/2210] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:38 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:38.476231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:38.480421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec57c4-f013-44b9-9d38-3fd99f71fd2c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.509046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec57c4-f013-44b9-9d38-3fd99f71fd2c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.670389 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa775c-5cf6-4dce-9613-603366b79222 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.699708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ab665-82bb-498f-ad90-4aaf418989d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.702005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ab665-82bb-498f-ad90-4aaf418989d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.702534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ab665-82bb-498f-ad90-4aaf418989d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.702987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ab665-82bb-498f-ad90-4aaf418989d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.704347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ab665-82bb-498f-ad90-4aaf418989d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.712798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ab665-82bb-498f-ad90-4aaf418989d3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.728164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8473-3b09-4862-b0ed-0501e576a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.729267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8473-3b09-4862-b0ed-0501e576a9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.729673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8473-3b09-4862-b0ed-0501e576a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.730076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8473-3b09-4862-b0ed-0501e576a9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.731914 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b8473-3b09-4862-b0ed-0501e576a9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.734274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b8473-3b09-4862-b0ed-0501e576a9e2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.737828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:38.760909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1104/2211] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:38 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:38.765433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ab665-82bb-498f-ad90-4aaf418989d3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.768775 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1108/2212] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:38.780254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8473-3b09-4862-b0ed-0501e576a9e2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.816345 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ab665-82bb-498f-ad90-4aaf418989d3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.838902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae678ad-e48d-42f5-9dec-16eb21c1a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.843561 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8473-3b09-4862-b0ed-0501e576a9e2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.843739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae678ad-e48d-42f5-9dec-16eb21c1a979 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.845232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae678ad-e48d-42f5-9dec-16eb21c1a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.847614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae678ad-e48d-42f5-9dec-16eb21c1a979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.850634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae678ad-e48d-42f5-9dec-16eb21c1a979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.861836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae678ad-e48d-42f5-9dec-16eb21c1a979 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.872977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc87f7-ca99-44cf-a4df-aa21fd303d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.879372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc87f7-ca99-44cf-a4df-aa21fd303d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.881051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc87f7-ca99-44cf-a4df-aa21fd303d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.881380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc87f7-ca99-44cf-a4df-aa21fd303d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.887384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc87f7-ca99-44cf-a4df-aa21fd303d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.894452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc87f7-ca99-44cf-a4df-aa21fd303d0f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.917322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1105/2213] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:13:38.918681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae678ad-e48d-42f5-9dec-16eb21c1a979 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.929343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1109/2214] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:38.941707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc87f7-ca99-44cf-a4df-aa21fd303d0f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:38.955714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae678ad-e48d-42f5-9dec-16eb21c1a979 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.968640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc87f7-ca99-44cf-a4df-aa21fd303d0f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:38.981823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b1c0c-3be6-42a5-80f5-1d90314835bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.982519 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b1c0c-3be6-42a5-80f5-1d90314835bc admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.982812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b1c0c-3be6-42a5-80f5-1d90314835bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.983093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b1c0c-3be6-42a5-80f5-1d90314835bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:38.985249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b1c0c-3be6-42a5-80f5-1d90314835bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:38.986960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b1c0c-3be6-42a5-80f5-1d90314835bc admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:38.996364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a87aa-85a5-4e7a-8ae9-deb7d1c86756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:38.997424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a87aa-85a5-4e7a-8ae9-deb7d1c86756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:38.997711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a87aa-85a5-4e7a-8ae9-deb7d1c86756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:38.997989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a87aa-85a5-4e7a-8ae9-deb7d1c86756 admin admin] PATH_INFO: `/v3/projects/dab76dfdb731408597d13bb36b0424a6/users/4a8bd5e0efae4228b810950e2fd96671/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:39.034017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1106/2215] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:39.037495 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b1c0c-3be6-42a5-80f5-1d90314835bc admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:39.057628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a87aa-85a5-4e7a-8ae9-deb7d1c86756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab76dfdb731408597d13bb36b0424a6, user_id=4a8bd5e0efae4228b810950e2fd96671, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:39.060371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a87aa-85a5-4e7a-8ae9-deb7d1c86756 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:39.075500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b1c0c-3be6-42a5-80f5-1d90314835bc admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:39.088380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7208fbe-1335-4ff3-b5dd-e9147342c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:39.090364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208fbe-1335-4ff3-b5dd-e9147342c534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:39.090364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208fbe-1335-4ff3-b5dd-e9147342c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:39.090364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208fbe-1335-4ff3-b5dd-e9147342c534 admin admin] PATH_INFO: `/v3/projects/fb6613f7c75848e3b4a3ef62d402ead8/users/eb6303a7cdfb49e6ab452d155d2e0be5/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:39.099740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1110/2216] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:38 2022] PUT /identity/v3/projects/dab76dfdb731408597d13bb36b0424a6/users/4a8bd5e0efae4228b810950e2fd96671/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:39.112374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba9341-6ae9-4948-a250-bc51c0767cca None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:39.112681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba9341-6ae9-4948-a250-bc51c0767cca None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:39.112942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba9341-6ae9-4948-a250-bc51c0767cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:39.136719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7208fbe-1335-4ff3-b5dd-e9147342c534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6613f7c75848e3b4a3ef62d402ead8, user_id=eb6303a7cdfb49e6ab452d155d2e0be5, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:39.139407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7208fbe-1335-4ff3-b5dd-e9147342c534 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:39.188198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1107/2217] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:39 2022] PUT /identity/v3/projects/fb6613f7c75848e3b4a3ef62d402ead8/users/eb6303a7cdfb49e6ab452d155d2e0be5/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:39.197345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-87ba9341-6ae9-4948-a250-bc51c0767cca None None] MFA Rules not processed for user `4a8bd5e0efae4228b810950e2fd96671`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:39.204184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f5c0a-a185-4efc-8bec-0406a1397c34 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:39.204609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f5c0a-a185-4efc-8bec-0406a1397c34 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:39.205093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f5c0a-a185-4efc-8bec-0406a1397c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:39.210861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-87ba9341-6ae9-4948-a250-bc51c0767cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:39.311388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ec5f5c0a-a185-4efc-8bec-0406a1397c34 None None] MFA Rules not processed for user `eb6303a7cdfb49e6ab452d155d2e0be5`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:39.312695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec5f5c0a-a185-4efc-8bec-0406a1397c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:39.436686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1111/2218] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:39.441155 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba9341-6ae9-4948-a250-bc51c0767cca None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:39.583213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1108/2219] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:39.588036 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f5c0a-a185-4efc-8bec-0406a1397c34 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:39.628526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba9341-6ae9-4948-a250-bc51c0767cca None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:39.642811 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458f99f-ea8b-45dd-947a-76cccfc2b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:39.643721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458f99f-ea8b-45dd-947a-76cccfc2b92c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:39.644140 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458f99f-ea8b-45dd-947a-76cccfc2b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:39.644524 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458f99f-ea8b-45dd-947a-76cccfc2b92c admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:39.645342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458f99f-ea8b-45dd-947a-76cccfc2b92c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:39.647393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458f99f-ea8b-45dd-947a-76cccfc2b92c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:39.736180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:39.748243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1112/2220] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:39 2022] POST /identity/v3/projects => generated 385 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:39.753889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458f99f-ea8b-45dd-947a-76cccfc2b92c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:39.804987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f5c0a-a185-4efc-8bec-0406a1397c34 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:39.891848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:39.955660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce36b1-83b8-49ee-b9b6-6e4d0dcf39c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:39.956646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce36b1-83b8-49ee-b9b6-6e4d0dcf39c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:39.957212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce36b1-83b8-49ee-b9b6-6e4d0dcf39c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:39.957610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce36b1-83b8-49ee-b9b6-6e4d0dcf39c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:39.958470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce36b1-83b8-49ee-b9b6-6e4d0dcf39c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:39.960655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce36b1-83b8-49ee-b9b6-6e4d0dcf39c3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:39.965278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458f99f-ea8b-45dd-947a-76cccfc2b92c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:39.978455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecab31-5b9d-4785-acc2-d541a0af7730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:39.979158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecab31-5b9d-4785-acc2-d541a0af7730 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:39.979500 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecab31-5b9d-4785-acc2-d541a0af7730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:39.979782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecab31-5b9d-4785-acc2-d541a0af7730 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:39.980547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecab31-5b9d-4785-acc2-d541a0af7730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:39.982538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecab31-5b9d-4785-acc2-d541a0af7730 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.023417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1109/2221] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:39 2022] POST /identity/v3/projects => generated 381 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:40.023614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1113/2222] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:39 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:40.023801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce36b1-83b8-49ee-b9b6-6e4d0dcf39c3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.024821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecab31-5b9d-4785-acc2-d541a0af7730 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.047842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecab31-5b9d-4785-acc2-d541a0af7730 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.125545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce36b1-83b8-49ee-b9b6-6e4d0dcf39c3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.131096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa28066-e394-4500-b890-335fa3a4adef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.131803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa28066-e394-4500-b890-335fa3a4adef admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.132118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa28066-e394-4500-b890-335fa3a4adef admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.132404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa28066-e394-4500-b890-335fa3a4adef admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.133172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa28066-e394-4500-b890-335fa3a4adef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:40.135132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa28066-e394-4500-b890-335fa3a4adef admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.168447 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1110/2223] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:40 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:40.171731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa28066-e394-4500-b890-335fa3a4adef admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.195272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa28066-e394-4500-b890-335fa3a4adef admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.209071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a6938-9c4a-4f7f-8502-7968e358b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.210228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a6938-9c4a-4f7f-8502-7968e358b106 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.211406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a6938-9c4a-4f7f-8502-7968e358b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.212331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260f5d8-760b-4305-9ba5-f57d036d1c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.213111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a6938-9c4a-4f7f-8502-7968e358b106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.213931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a6938-9c4a-4f7f-8502-7968e358b106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:40.215573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a6938-9c4a-4f7f-8502-7968e358b106 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.217051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f5d8-760b-4305-9ba5-f57d036d1c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.217416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f5d8-760b-4305-9ba5-f57d036d1c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.217706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f5d8-760b-4305-9ba5-f57d036d1c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.218469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260f5d8-760b-4305-9ba5-f57d036d1c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:40.220248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260f5d8-760b-4305-9ba5-f57d036d1c7e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.238459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1111/2224] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:40.244701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a6938-9c4a-4f7f-8502-7968e358b106 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.249632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1114/2225] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:40.252450 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260f5d8-760b-4305-9ba5-f57d036d1c7e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.270410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a6938-9c4a-4f7f-8502-7968e358b106 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.275619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260f5d8-760b-4305-9ba5-f57d036d1c7e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.278503 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d225d-005e-40b7-9857-35eac098b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.280024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d225d-005e-40b7-9857-35eac098b33b admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.280275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d225d-005e-40b7-9857-35eac098b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.280657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d225d-005e-40b7-9857-35eac098b33b admin admin] PATH_INFO: `/v3/projects/a77e4c62308e4893a0dc76640ccaf9a6/users/4f793da8ba3d4dfda0c6b97c1e0eac01/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.298941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3561e44-192e-412a-a7df-7480f3e779c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.304845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3561e44-192e-412a-a7df-7480f3e779c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.305208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3561e44-192e-412a-a7df-7480f3e779c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.306104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3561e44-192e-412a-a7df-7480f3e779c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.306342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d225d-005e-40b7-9857-35eac098b33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77e4c62308e4893a0dc76640ccaf9a6, user_id=4f793da8ba3d4dfda0c6b97c1e0eac01, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:40.306978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3561e44-192e-412a-a7df-7480f3e779c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:40.308917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3561e44-192e-412a-a7df-7480f3e779c0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.311147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d225d-005e-40b7-9857-35eac098b33b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.334702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1112/2226] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:40 2022] PUT /identity/v3/projects/a77e4c62308e4893a0dc76640ccaf9a6/users/4f793da8ba3d4dfda0c6b97c1e0eac01/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:40.339701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d225d-005e-40b7-9857-35eac098b33b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.340943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1115/2227] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:40.344865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3561e44-192e-412a-a7df-7480f3e779c0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.370397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3561e44-192e-412a-a7df-7480f3e779c0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.376234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:40.454820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17b8e0-8c2c-4d18-b534-fc5e9be2a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.457596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17b8e0-8c2c-4d18-b534-fc5e9be2a630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.457898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17b8e0-8c2c-4d18-b534-fc5e9be2a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.458193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17b8e0-8c2c-4d18-b534-fc5e9be2a630 admin admin] PATH_INFO: `/v3/projects/f963ea2f692147a19f0b5ad4c3e3ef33/users/6efe942f08d8428a865a0a26408ba1e0/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.470001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d225d-005e-40b7-9857-35eac098b33b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.475866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17b8e0-8c2c-4d18-b534-fc5e9be2a630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f963ea2f692147a19f0b5ad4c3e3ef33, user_id=6efe942f08d8428a865a0a26408ba1e0, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:40.478753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17b8e0-8c2c-4d18-b534-fc5e9be2a630 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.488824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa935104-7e09-4ed5-bba6-173032feba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.490113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa935104-7e09-4ed5-bba6-173032feba70 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.490658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa935104-7e09-4ed5-bba6-173032feba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.491130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa935104-7e09-4ed5-bba6-173032feba70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.492202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa935104-7e09-4ed5-bba6-173032feba70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:40.494009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa935104-7e09-4ed5-bba6-173032feba70 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.516314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1113/2228] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:40.518884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa935104-7e09-4ed5-bba6-173032feba70 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.532075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1116/2229] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:40 2022] PUT /identity/v3/projects/f963ea2f692147a19f0b5ad4c3e3ef33/users/6efe942f08d8428a865a0a26408ba1e0/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:40.535574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d959ffe-f531-4d84-9f22-7828952dc29d None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.535869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d959ffe-f531-4d84-9f22-7828952dc29d None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.536182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d959ffe-f531-4d84-9f22-7828952dc29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.540333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa935104-7e09-4ed5-bba6-173032feba70 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.599042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7d959ffe-f531-4d84-9f22-7828952dc29d None None] MFA Rules not processed for user `6efe942f08d8428a865a0a26408ba1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:40.603560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7d959ffe-f531-4d84-9f22-7828952dc29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:40.628892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:40.691862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89e8bb-c669-4fb0-8645-ced67890005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.693048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89e8bb-c669-4fb0-8645-ced67890005b admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.693437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89e8bb-c669-4fb0-8645-ced67890005b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.693814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89e8bb-c669-4fb0-8645-ced67890005b admin admin] PATH_INFO: `/v3/projects/a77e4c62308e4893a0dc76640ccaf9a6/users/4f793da8ba3d4dfda0c6b97c1e0eac01/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.698596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89e8bb-c669-4fb0-8645-ced67890005b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77e4c62308e4893a0dc76640ccaf9a6, user_id=4f793da8ba3d4dfda0c6b97c1e0eac01, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:40.703019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1117/2230] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:40.703163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89e8bb-c669-4fb0-8645-ced67890005b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.704582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d959ffe-f531-4d84-9f22-7828952dc29d None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.730691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d959ffe-f531-4d84-9f22-7828952dc29d None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.731933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1114/2231] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:40 2022] PUT /identity/v3/projects/a77e4c62308e4893a0dc76640ccaf9a6/users/4f793da8ba3d4dfda0c6b97c1e0eac01/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:40.742186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6ac69-2c5a-4c3f-96a8-daa5b16999f0 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.744234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6ac69-2c5a-4c3f-96a8-daa5b16999f0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.744750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6ac69-2c5a-4c3f-96a8-daa5b16999f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.776887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-55f6ac69-2c5a-4c3f-96a8-daa5b16999f0 None None] MFA Rules not processed for user `4f793da8ba3d4dfda0c6b97c1e0eac01`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:40.778654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-55f6ac69-2c5a-4c3f-96a8-daa5b16999f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:40.827925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e49a2e-95be-4269-a409-95e0a57f442b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.828894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e49a2e-95be-4269-a409-95e0a57f442b admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.829285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e49a2e-95be-4269-a409-95e0a57f442b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:40.829757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e49a2e-95be-4269-a409-95e0a57f442b admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:40.831403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e49a2e-95be-4269-a409-95e0a57f442b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:40.834729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e49a2e-95be-4269-a409-95e0a57f442b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:40.891953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1118/2232] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:40 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:40.896325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e49a2e-95be-4269-a409-95e0a57f442b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.949294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1115/2233] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:40.963498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6ac69-2c5a-4c3f-96a8-daa5b16999f0 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:40.965298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-55f6ac69-2c5a-4c3f-96a8-daa5b16999f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:40.984593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e49a2e-95be-4269-a409-95e0a57f442b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:40.998692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322836ff-c296-4133-a3f2-725a14851ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:40.999537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322836ff-c296-4133-a3f2-725a14851ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:40.999925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322836ff-c296-4133-a3f2-725a14851ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:41.000204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322836ff-c296-4133-a3f2-725a14851ffb admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:41.003834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322836ff-c296-4133-a3f2-725a14851ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:41.011212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322836ff-c296-4133-a3f2-725a14851ffb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:41.032901 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:41.049522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1119/2234] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:40 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:41.052259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322836ff-c296-4133-a3f2-725a14851ffb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:41.062110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6ac69-2c5a-4c3f-96a8-daa5b16999f0 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:41.076846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322836ff-c296-4133-a3f2-725a14851ffb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:41.088547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8da4f-9fea-411e-aafe-a02e16ba2602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:41.089239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8da4f-9fea-411e-aafe-a02e16ba2602 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:41.089522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8da4f-9fea-411e-aafe-a02e16ba2602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:41.089799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8da4f-9fea-411e-aafe-a02e16ba2602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:41.090542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8da4f-9fea-411e-aafe-a02e16ba2602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:41.092172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8da4f-9fea-411e-aafe-a02e16ba2602 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:41.112064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1120/2235] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:41.118249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8da4f-9fea-411e-aafe-a02e16ba2602 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:41.147855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea719db-2c9f-4be8-8f37-d348c028fe17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:41.149751 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea719db-2c9f-4be8-8f37-d348c028fe17 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:41.150208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea719db-2c9f-4be8-8f37-d348c028fe17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:41.150806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea719db-2c9f-4be8-8f37-d348c028fe17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:41.150941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8da4f-9fea-411e-aafe-a02e16ba2602 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:41.173055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f02cd7-2adb-417b-a01f-3fd24b4deae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:41.174108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f02cd7-2adb-417b-a01f-3fd24b4deae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:41.174435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f02cd7-2adb-417b-a01f-3fd24b4deae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:41.174671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f02cd7-2adb-417b-a01f-3fd24b4deae8 admin admin] PATH_INFO: `/v3/projects/4c79c4fdc068493aab8ad09ba21361d5/users/ae28fb65285b4cc4b279100ee40b049d/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:41.205084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f02cd7-2adb-417b-a01f-3fd24b4deae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c79c4fdc068493aab8ad09ba21361d5, user_id=ae28fb65285b4cc4b279100ee40b049d, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:41.208629 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f02cd7-2adb-417b-a01f-3fd24b4deae8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:41.245400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1121/2236] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:41 2022] PUT /identity/v3/projects/4c79c4fdc068493aab8ad09ba21361d5/users/ae28fb65285b4cc4b279100ee40b049d/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:41.247463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f02cd7-2adb-417b-a01f-3fd24b4deae8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:41.258847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:41.289310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea719db-2c9f-4be8-8f37-d348c028fe17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:41.290811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea719db-2c9f-4be8-8f37-d348c028fe17 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:41.301458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1116/2237] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:41.350094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f02cd7-2adb-417b-a01f-3fd24b4deae8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:41.356162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45b9d0-cd11-4134-b0ff-14ac6f2ad2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:41.356678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b9d0-cd11-4134-b0ff-14ac6f2ad2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:41.357043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b9d0-cd11-4134-b0ff-14ac6f2ad2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:41.357553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b9d0-cd11-4134-b0ff-14ac6f2ad2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:41.358463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45b9d0-cd11-4134-b0ff-14ac6f2ad2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:41.360118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45b9d0-cd11-4134-b0ff-14ac6f2ad2e1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:41.378675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1122/2238] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:41.382732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea719db-2c9f-4be8-8f37-d348c028fe17 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:41.396888 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea719db-2c9f-4be8-8f37-d348c028fe17 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:41.402633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12fb7c-0400-471c-a31e-c413bd6fd19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:41.403552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12fb7c-0400-471c-a31e-c413bd6fd19b admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:41.403829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12fb7c-0400-471c-a31e-c413bd6fd19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:41.404147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12fb7c-0400-471c-a31e-c413bd6fd19b admin admin] PATH_INFO: `/v3/projects/4c79c4fdc068493aab8ad09ba21361d5/users/ae28fb65285b4cc4b279100ee40b049d/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:41.406310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12fb7c-0400-471c-a31e-c413bd6fd19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c79c4fdc068493aab8ad09ba21361d5, user_id=ae28fb65285b4cc4b279100ee40b049d, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:41.410426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12fb7c-0400-471c-a31e-c413bd6fd19b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:41.442843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1117/2239] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:41 2022] PUT /identity/v3/projects/4c79c4fdc068493aab8ad09ba21361d5/users/ae28fb65285b4cc4b279100ee40b049d/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:41.453419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eb49a-c518-453e-91ce-7c7ac9668b7e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:41.460654 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eb49a-c518-453e-91ce-7c7ac9668b7e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:41.461214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eb49a-c518-453e-91ce-7c7ac9668b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:41.499190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c52eb49a-c518-453e-91ce-7c7ac9668b7e None None] MFA Rules not processed for user `ae28fb65285b4cc4b279100ee40b049d`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:41.500903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c52eb49a-c518-453e-91ce-7c7ac9668b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:41.610240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1123/2240] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:41.623272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12fb7c-0400-471c-a31e-c413bd6fd19b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:41.760392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12fb7c-0400-471c-a31e-c413bd6fd19b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:41.776271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd1dd0-1254-47b8-8b71-3254724b366a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:41.777066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd1dd0-1254-47b8-8b71-3254724b366a service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:41.777358 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd1dd0-1254-47b8-8b71-3254724b366a service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:41.780128 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd1dd0-1254-47b8-8b71-3254724b366a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:41.916533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:41.935867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd1dd0-1254-47b8-8b71-3254724b366a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:41.938156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd1dd0-1254-47b8-8b71-3254724b366a service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:41.951681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1118/2241] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:43.753966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eb49a-c518-453e-91ce-7c7ac9668b7e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:43.764570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eb49a-c518-453e-91ce-7c7ac9668b7e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:43.769545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901769d4-112c-488c-937f-d1ccd2f4a143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:43.770383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901769d4-112c-488c-937f-d1ccd2f4a143 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:43.770670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901769d4-112c-488c-937f-d1ccd2f4a143 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:43.770949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901769d4-112c-488c-937f-d1ccd2f4a143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:43.840124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901769d4-112c-488c-937f-d1ccd2f4a143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:43.842491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901769d4-112c-488c-937f-d1ccd2f4a143 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:43.860693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1124/2242] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:44.116362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd1dd0-1254-47b8-8b71-3254724b366a service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:44.118498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-25bd1dd0-1254-47b8-8b71-3254724b366a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:44.272215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd1dd0-1254-47b8-8b71-3254724b366a service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:44.278147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:44.279101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:44.279734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:44.291097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] PATH_INFO: `/v3/users/d35e17f0fecd43fe900860ad108d8e9c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:44.297757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35e17f0fecd43fe900860ad108d8e9c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:44.310195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:44.385679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35e17f0fecd43fe900860ad108d8e9c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:44.409150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35e17f0fecd43fe900860ad108d8e9c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:44.425583 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35e17f0fecd43fe900860ad108d8e9c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:44.426243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35e17f0fecd43fe900860ad108d8e9c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:44.426851 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35e17f0fecd43fe900860ad108d8e9c'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:44.450664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1119/2243] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:44 2022] DELETE /identity/v3/users/d35e17f0fecd43fe900860ad108d8e9c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:44.778655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901769d4-112c-488c-937f-d1ccd2f4a143 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:44.797637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901769d4-112c-488c-937f-d1ccd2f4a143 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:44.839260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:44.954194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:44.954380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:44.954594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:44.954808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] PATH_INFO: `/v3/projects/c2ed7e9f2ace469c8f83c51b0e2ba57d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:44.956559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ed7e9f2ace469c8f83c51b0e2ba57d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:44.961405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:44.974013 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:44.975539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:45.129348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ed7e9f2ace469c8f83c51b0e2ba57d', 'request_id': 'req-111fd832-a1ae-4316-a390-bb8beb98f852'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.166599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd7e78-b3d9-4d8d-9d87-a67d5346d634 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:45.180054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ed7e9f2ace469c8f83c51b0e2ba57d', 'request_id': 'req-111fd832-a1ae-4316-a390-bb8beb98f852'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.188353 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ed7e9f2ace469c8f83c51b0e2ba57d', 'request_id': 'req-111fd832-a1ae-4316-a390-bb8beb98f852'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.225399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:45.264111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] The token cache is being invalidate because project c2ed7e9f2ace469c8f83c51b0e2ba57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:45.264664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.266733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.273954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1125/2244] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:44 2022] DELETE /identity/v3/projects/c2ed7e9f2ace469c8f83c51b0e2ba57d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:45.278921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:45.281586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:45.288162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95e0f-7992-497d-a185-26ceb340fd45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:45.290433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95e0f-7992-497d-a185-26ceb340fd45 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:45.290781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95e0f-7992-497d-a185-26ceb340fd45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:45.291073 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95e0f-7992-497d-a185-26ceb340fd45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:45.295916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3fd95e0f-7992-497d-a185-26ceb340fd45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:45.445165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fd832-a1ae-4316-a390-bb8beb98f852 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:45.460948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:45.462568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:45.463053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:45.464157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] PATH_INFO: `/v3/users/9180a2ba34ec4d659d4ff3da263408d3` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:45.468374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9180a2ba34ec4d659d4ff3da263408d3)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:45.468544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95e0f-7992-497d-a185-26ceb340fd45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:45.470597 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95e0f-7992-497d-a185-26ceb340fd45 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:45.473486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:45.487095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1120/2245] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:45.577727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9180a2ba34ec4d659d4ff3da263408d3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.590227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9180a2ba34ec4d659d4ff3da263408d3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.592385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9180a2ba34ec4d659d4ff3da263408d3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.598697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:45.618188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9180a2ba34ec4d659d4ff3da263408d3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.619234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-a2a12ad6-36b0-409f-9ac9-995ee09bf94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9180a2ba34ec4d659d4ff3da263408d3'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:45.637618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1126/2246] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:45 2022] DELETE /identity/v3/users/9180a2ba34ec4d659d4ff3da263408d3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:45.914426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95e0f-7992-497d-a185-26ceb340fd45 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:45.929111 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95e0f-7992-497d-a185-26ceb340fd45 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:46.023050 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:46.023968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.024290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.024740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] PATH_INFO: `/v3/projects/c14754e135504a40959ed74fe9f133c1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.027286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14754e135504a40959ed74fe9f133c1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:46.029482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:46.087230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14754e135504a40959ed74fe9f133c1', 'request_id': 'req-8d1bfd8c-f029-440e-9696-1c70e20139f7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:46.095165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14754e135504a40959ed74fe9f133c1', 'request_id': 'req-8d1bfd8c-f029-440e-9696-1c70e20139f7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:46.132564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14754e135504a40959ed74fe9f133c1', 'request_id': 'req-8d1bfd8c-f029-440e-9696-1c70e20139f7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:46.151465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] The token cache is being invalidate because project c14754e135504a40959ed74fe9f133c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:46.152054 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:46.152935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-8d1bfd8c-f029-440e-9696-1c70e20139f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:46.159820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1121/2247] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:45 2022] DELETE /identity/v3/projects/c14754e135504a40959ed74fe9f133c1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:46.161386 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb3c2c-dd6f-4a1f-86a6-4dd5a0fb636e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.162044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb3c2c-dd6f-4a1f-86a6-4dd5a0fb636e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.162044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb3c2c-dd6f-4a1f-86a6-4dd5a0fb636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.195596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a9bb3c2c-dd6f-4a1f-86a6-4dd5a0fb636e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:46.196931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a9bb3c2c-dd6f-4a1f-86a6-4dd5a0fb636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:46.294609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c4a87-045c-43ea-a272-5c048ec0c588 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.295193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c4a87-045c-43ea-a272-5c048ec0c588 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.295193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c4a87-045c-43ea-a272-5c048ec0c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.299870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1127/2248] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:46.313109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:46.321443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-398c4a87-045c-43ea-a272-5c048ec0c588 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:46.324563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-398c4a87-045c-43ea-a272-5c048ec0c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:46.342160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb3c2c-dd6f-4a1f-86a6-4dd5a0fb636e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:46.360207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1122/2249] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:46.360517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb3c2c-dd6f-4a1f-86a6-4dd5a0fb636e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:46.374157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:46.375161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.375455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.375736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.376507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:46.377374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:46.379150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:46.413578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1128/2250] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:13:46.417869 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c4a87-045c-43ea-a272-5c048ec0c588 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:46.436630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:46.437452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c4a87-045c-43ea-a272-5c048ec0c588 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:46.442264 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:46.452160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a47f2c-a849-4426-aa1e-cdbb27a1f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:46.452850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a47f2c-a849-4426-aa1e-cdbb27a1f628 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.453145 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a47f2c-a849-4426-aa1e-cdbb27a1f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.453403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a47f2c-a849-4426-aa1e-cdbb27a1f628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.454105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a47f2c-a849-4426-aa1e-cdbb27a1f628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:46.460433 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a47f2c-a849-4426-aa1e-cdbb27a1f628 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:46.496553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1123/2251] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:46 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:46.497564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a47f2c-a849-4426-aa1e-cdbb27a1f628 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:46.523479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdbee9-64be-4c22-a591-a15c15944a42 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:46.588618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba54fa-cb5c-45fc-98a3-e13bf9899d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:46.589770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba54fa-cb5c-45fc-98a3-e13bf9899d06 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.590222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba54fa-cb5c-45fc-98a3-e13bf9899d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.590659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba54fa-cb5c-45fc-98a3-e13bf9899d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.593032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4eba54fa-cb5c-45fc-98a3-e13bf9899d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:46.640498 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:46.646374 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a47f2c-a849-4426-aa1e-cdbb27a1f628 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:46.652126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f799b47-c57d-4d64-8d00-b8a102deb68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:46.652895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f799b47-c57d-4d64-8d00-b8a102deb68f admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.653721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f799b47-c57d-4d64-8d00-b8a102deb68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.654053 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f799b47-c57d-4d64-8d00-b8a102deb68f admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.654942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f799b47-c57d-4d64-8d00-b8a102deb68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:46.657171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f799b47-c57d-4d64-8d00-b8a102deb68f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:46.681569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1124/2252] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:46 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:46.684995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f799b47-c57d-4d64-8d00-b8a102deb68f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:46.685118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba54fa-cb5c-45fc-98a3-e13bf9899d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:46.687448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba54fa-cb5c-45fc-98a3-e13bf9899d06 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:46.697600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f799b47-c57d-4d64-8d00-b8a102deb68f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:46.707776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1129/2253] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:46.710617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedb04d-2ca9-483a-87a9-e28bd0a226b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:46.711311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb04d-2ca9-483a-87a9-e28bd0a226b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.711603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb04d-2ca9-483a-87a9-e28bd0a226b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.711890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb04d-2ca9-483a-87a9-e28bd0a226b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.712694 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedb04d-2ca9-483a-87a9-e28bd0a226b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:46.714410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedb04d-2ca9-483a-87a9-e28bd0a226b7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:46.725908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1125/2254] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:13:46.730124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba54fa-cb5c-45fc-98a3-e13bf9899d06 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:46.743708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba54fa-cb5c-45fc-98a3-e13bf9899d06 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:46.755520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3829b-d34c-41a7-aadb-72f65a084078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:46.756420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3829b-d34c-41a7-aadb-72f65a084078 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.756909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3829b-d34c-41a7-aadb-72f65a084078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.757588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3829b-d34c-41a7-aadb-72f65a084078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.758496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3829b-d34c-41a7-aadb-72f65a084078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:46.760926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3829b-d34c-41a7-aadb-72f65a084078 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:46.777501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1130/2255] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:46.781680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedb04d-2ca9-483a-87a9-e28bd0a226b7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:46.793185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedb04d-2ca9-483a-87a9-e28bd0a226b7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:46.799679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe72c5-cd28-4fdb-a2db-ae6b882b19be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:46.801270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe72c5-cd28-4fdb-a2db-ae6b882b19be admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.801561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe72c5-cd28-4fdb-a2db-ae6b882b19be admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.802926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe72c5-cd28-4fdb-a2db-ae6b882b19be admin admin] PATH_INFO: `/v3/projects/75bb0d579e1044cbadb84860f43235a1/users/ed857957b6854897b2e75d8604bb6b96/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.838467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe72c5-cd28-4fdb-a2db-ae6b882b19be admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bb0d579e1044cbadb84860f43235a1, user_id=ed857957b6854897b2e75d8604bb6b96, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:46.841532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe72c5-cd28-4fdb-a2db-ae6b882b19be admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:46.875954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1126/2256] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:46 2022] PUT /identity/v3/projects/75bb0d579e1044cbadb84860f43235a1/users/ed857957b6854897b2e75d8604bb6b96/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:46.885134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0de89-6743-4e0e-aa3c-8bd06fb2e8c1 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:46.885422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0de89-6743-4e0e-aa3c-8bd06fb2e8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:46.885707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0de89-6743-4e0e-aa3c-8bd06fb2e8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:46.937004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-53b0de89-6743-4e0e-aa3c-8bd06fb2e8c1 None None] MFA Rules not processed for user `ed857957b6854897b2e75d8604bb6b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:46.938839 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-53b0de89-6743-4e0e-aa3c-8bd06fb2e8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:47.060061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1131/2257] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:47.069535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe72c5-cd28-4fdb-a2db-ae6b882b19be admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:47.072059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7ffe72c5-cd28-4fdb-a2db-ae6b882b19be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:47.238490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe72c5-cd28-4fdb-a2db-ae6b882b19be admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:47.246143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749be568-6e05-443c-b6cc-5e902cce0cc9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7d9cfbbcd4068aa9241ffd694c631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:47.246892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be568-6e05-443c-b6cc-5e902cce0cc9 service glance] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:47.247142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be568-6e05-443c-b6cc-5e902cce0cc9 service glance] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:47.247599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be568-6e05-443c-b6cc-5e902cce0cc9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:47.269224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749be568-6e05-443c-b6cc-5e902cce0cc9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:47.273139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749be568-6e05-443c-b6cc-5e902cce0cc9 service glance] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:47.331883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1127/2258] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:50.859758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0de89-6743-4e0e-aa3c-8bd06fb2e8c1 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:50.861273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-53b0de89-6743-4e0e-aa3c-8bd06fb2e8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:50.932687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0de89-6743-4e0e-aa3c-8bd06fb2e8c1 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:50.937418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:50.938297 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:50.938582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:50.938864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] PATH_INFO: `/v3/users/4a8bd5e0efae4228b810950e2fd96671` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:50.940668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8bd5e0efae4228b810950e2fd96671)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:50.942598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:50.989821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:50.991480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8bd5e0efae4228b810950e2fd96671'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.003351 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8bd5e0efae4228b810950e2fd96671'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.004050 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8bd5e0efae4228b810950e2fd96671'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.019147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8bd5e0efae4228b810950e2fd96671'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.020073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8bd5e0efae4228b810950e2fd96671'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.039080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1132/2259] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:50 2022] DELETE /identity/v3/users/4a8bd5e0efae4228b810950e2fd96671 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:51.042632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76342891-d885-4bfe-92fe-cdcf0ff8afa1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:51.043550 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76342891-d885-4bfe-92fe-cdcf0ff8afa1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:51.043781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76342891-d885-4bfe-92fe-cdcf0ff8afa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:51.062757 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-76342891-d885-4bfe-92fe-cdcf0ff8afa1 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:51.064376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-76342891-d885-4bfe-92fe-cdcf0ff8afa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:51.098450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:51.133696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1128/2260] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:51.143767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:51.145255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:51.207171 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b7a93-a967-4849-b30b-1cf56d51431b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:51.210938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1012f-96aa-422e-af32-759588fd0428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:51.211586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1012f-96aa-422e-af32-759588fd0428 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:51.211869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1012f-96aa-422e-af32-759588fd0428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:51.212178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1012f-96aa-422e-af32-759588fd0428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:51.222262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1012f-96aa-422e-af32-759588fd0428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:51.223233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1012f-96aa-422e-af32-759588fd0428 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:51.232904 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1133/2261] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:51.508120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76342891-d885-4bfe-92fe-cdcf0ff8afa1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:51.509584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-76342891-d885-4bfe-92fe-cdcf0ff8afa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:51.538067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76342891-d885-4bfe-92fe-cdcf0ff8afa1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:51.544862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:51.545747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:51.546037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:51.546362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] PATH_INFO: `/v3/projects/dab76dfdb731408597d13bb36b0424a6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:51.550363 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab76dfdb731408597d13bb36b0424a6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:51.553271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:51.614376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab76dfdb731408597d13bb36b0424a6', 'request_id': 'req-66b245db-c343-44c5-a81e-cbef070bc6f9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.626351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab76dfdb731408597d13bb36b0424a6', 'request_id': 'req-66b245db-c343-44c5-a81e-cbef070bc6f9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.633823 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab76dfdb731408597d13bb36b0424a6', 'request_id': 'req-66b245db-c343-44c5-a81e-cbef070bc6f9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.646089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] The token cache is being invalidate because project dab76dfdb731408597d13bb36b0424a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:51.646382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.647037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.648671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1129/2262] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:51 2022] DELETE /identity/v3/projects/dab76dfdb731408597d13bb36b0424a6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:51.652815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1012f-96aa-422e-af32-759588fd0428 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:51.664202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1012f-96aa-422e-af32-759588fd0428 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:51.726953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:51.727859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:51.728176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:51.728453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] PATH_INFO: `/v3/users/6efe942f08d8428a865a0a26408ba1e0` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:51.729646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efe942f08d8428a865a0a26408ba1e0)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:51.731541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:51.787024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efe942f08d8428a865a0a26408ba1e0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.797788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efe942f08d8428a865a0a26408ba1e0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.799804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efe942f08d8428a865a0a26408ba1e0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.811485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:51.814613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efe942f08d8428a865a0a26408ba1e0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.815628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efe942f08d8428a865a0a26408ba1e0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:51.850270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1134/2263] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:51 2022] DELETE /identity/v3/users/6efe942f08d8428a865a0a26408ba1e0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:52.479321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:52.481238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:52.500688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b245db-c343-44c5-a81e-cbef070bc6f9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:52.577638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:52.579383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:52.579383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:52.579383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] PATH_INFO: `/v3/projects/f963ea2f692147a19f0b5ad4c3e3ef33` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:52.581740 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f963ea2f692147a19f0b5ad4c3e3ef33)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:52.583741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:52.632189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f963ea2f692147a19f0b5ad4c3e3ef33', 'request_id': 'req-e9bef87b-6390-491b-9370-4903d13ae025'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.638281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f963ea2f692147a19f0b5ad4c3e3ef33', 'request_id': 'req-e9bef87b-6390-491b-9370-4903d13ae025'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.645876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f963ea2f692147a19f0b5ad4c3e3ef33', 'request_id': 'req-e9bef87b-6390-491b-9370-4903d13ae025'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.647105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:52.658394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] The token cache is being invalidate because project f963ea2f692147a19f0b5ad4c3e3ef33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:52.658681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.659305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.660900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1130/2264] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:52 2022] DELETE /identity/v3/projects/f963ea2f692147a19f0b5ad4c3e3ef33 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:52.664956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:52.666494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:52.681920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d18f8-8d70-4493-a485-3a6e8fcc73a7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:52.749015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:52.749910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:52.750246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:52.750531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] PATH_INFO: `/v3/users/ae28fb65285b4cc4b279100ee40b049d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:52.752930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae28fb65285b4cc4b279100ee40b049d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:52.754393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:52.857185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae28fb65285b4cc4b279100ee40b049d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.869679 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae28fb65285b4cc4b279100ee40b049d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.871654 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae28fb65285b4cc4b279100ee40b049d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.892864 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae28fb65285b4cc4b279100ee40b049d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.894064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae28fb65285b4cc4b279100ee40b049d'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:52.907739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1135/2265] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:52 2022] DELETE /identity/v3/users/ae28fb65285b4cc4b279100ee40b049d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:53.306939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:53.308734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:53.319736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:53.321730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:53.338933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bef87b-6390-491b-9370-4903d13ae025 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:53.452470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:53.453364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:53.453665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:53.453981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] PATH_INFO: `/v3/users/eb6303a7cdfb49e6ab452d155d2e0be5` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:53.455413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6303a7cdfb49e6ab452d155d2e0be5)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:53.460507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14941e-9ab7-418c-b544-874c4ccde6b7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:53.463633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:53.468893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:53.470037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:53.470562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:53.470995 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] PATH_INFO: `/v3/projects/4c79c4fdc068493aab8ad09ba21361d5` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:53.474079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c79c4fdc068493aab8ad09ba21361d5)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:53.476265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:53.487290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:53.549426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6303a7cdfb49e6ab452d155d2e0be5'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.561625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6303a7cdfb49e6ab452d155d2e0be5'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.587271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6303a7cdfb49e6ab452d155d2e0be5'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.592582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6303a7cdfb49e6ab452d155d2e0be5'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.598209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d96810af-c283-40cf-a555-6cd83b00ccd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6303a7cdfb49e6ab452d155d2e0be5'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.601574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c79c4fdc068493aab8ad09ba21361d5', 'request_id': 'req-54471799-07a9-47b7-92d4-83906d2a7104'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.616784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c79c4fdc068493aab8ad09ba21361d5', 'request_id': 'req-54471799-07a9-47b7-92d4-83906d2a7104'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.635138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1131/2266] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:53 2022] DELETE /identity/v3/users/eb6303a7cdfb49e6ab452d155d2e0be5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:53.639413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d2a0-9e97-4043-b5ad-300a901ddeff None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:53.639706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d2a0-9e97-4043-b5ad-300a901ddeff None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:53.640022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d2a0-9e97-4043-b5ad-300a901ddeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:53.651093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c79c4fdc068493aab8ad09ba21361d5', 'request_id': 'req-54471799-07a9-47b7-92d4-83906d2a7104'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.658470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-37d6d2a0-9e97-4043-b5ad-300a901ddeff None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:53.659867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-37d6d2a0-9e97-4043-b5ad-300a901ddeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:53.667495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] The token cache is being invalidate because project 4c79c4fdc068493aab8ad09ba21361d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:53.668029 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.668572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-54471799-07a9-47b7-92d4-83906d2a7104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:53.670436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1136/2267] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:53 2022] DELETE /identity/v3/projects/4c79c4fdc068493aab8ad09ba21361d5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:53.676127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe611b9-b253-4858-89d1-9ce40cc09801 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:53.676479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe611b9-b253-4858-89d1-9ce40cc09801 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:53.676825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe611b9-b253-4858-89d1-9ce40cc09801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:53.699954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-abe611b9-b253-4858-89d1-9ce40cc09801 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:53.701302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-abe611b9-b253-4858-89d1-9ce40cc09801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:53.732257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1132/2268] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:53.745067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d2a0-9e97-4043-b5ad-300a901ddeff None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:53.747882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-37d6d2a0-9e97-4043-b5ad-300a901ddeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:53.764309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:53.776781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1137/2269] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:53.784847 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e823-b9fe-41aa-a6f5-e791a5be69bb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:53.785002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e823-b9fe-41aa-a6f5-e791a5be69bb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:53.785191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e823-b9fe-41aa-a6f5-e791a5be69bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:53.804137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9158e823-b9fe-41aa-a6f5-e791a5be69bb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:53.805358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9158e823-b9fe-41aa-a6f5-e791a5be69bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:53.813454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1138/2270] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:53.817047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d2a0-9e97-4043-b5ad-300a901ddeff None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:53.817799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158e823-b9fe-41aa-a6f5-e791a5be69bb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:53.821017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7a241-91f4-4398-abf3-58348dd803f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:53.821671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7a241-91f4-4398-abf3-58348dd803f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:53.821959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7a241-91f4-4398-abf3-58348dd803f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:53.822241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7a241-91f4-4398-abf3-58348dd803f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:53.827789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158e823-b9fe-41aa-a6f5-e791a5be69bb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:53.833389 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d1925-bda4-4737-95d6-049635c2f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:53.834020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d1925-bda4-4737-95d6-049635c2f3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:53.834302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d1925-bda4-4737-95d6-049635c2f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:53.834579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d1925-bda4-4737-95d6-049635c2f3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:53.835408 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d1925-bda4-4737-95d6-049635c2f3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:53.835602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d1925-bda4-4737-95d6-049635c2f3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:53.836209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7a241-91f4-4398-abf3-58348dd803f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:53.837233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d1925-bda4-4737-95d6-049635c2f3a6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:53.837663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7a241-91f4-4398-abf3-58348dd803f4 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:53.853677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1139/2271] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:13:53.853862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1133/2272] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:53.854896 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d1925-bda4-4737-95d6-049635c2f3a6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:53.866160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d1925-bda4-4737-95d6-049635c2f3a6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:53.871060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b978638-905c-4b77-9d45-b8facd2b4eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:53.871723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b978638-905c-4b77-9d45-b8facd2b4eea admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:53.872064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b978638-905c-4b77-9d45-b8facd2b4eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:53.872313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b978638-905c-4b77-9d45-b8facd2b4eea admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:53.873005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b978638-905c-4b77-9d45-b8facd2b4eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:53.874888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b978638-905c-4b77-9d45-b8facd2b4eea admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:53.912728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1140/2273] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:53 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:53.914093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7a241-91f4-4398-abf3-58348dd803f4 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:53.927782 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7a241-91f4-4398-abf3-58348dd803f4 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:54.023826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5716342-9d22-403c-bdc4-5d37b988a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:54.024566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5716342-9d22-403c-bdc4-5d37b988a056 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:54.024856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5716342-9d22-403c-bdc4-5d37b988a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:54.027824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5716342-9d22-403c-bdc4-5d37b988a056 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:54.027824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5716342-9d22-403c-bdc4-5d37b988a056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:54.036300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5716342-9d22-403c-bdc4-5d37b988a056 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:54.064668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1134/2274] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:53 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:54.069146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b978638-905c-4b77-9d45-b8facd2b4eea admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:54.082339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b978638-905c-4b77-9d45-b8facd2b4eea admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:54.087950 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905bfb2-ff68-476a-ab46-976673d7e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:54.089664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905bfb2-ff68-476a-ab46-976673d7e7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:54.089664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905bfb2-ff68-476a-ab46-976673d7e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:54.089664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905bfb2-ff68-476a-ab46-976673d7e7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:54.089924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905bfb2-ff68-476a-ab46-976673d7e7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:54.091935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905bfb2-ff68-476a-ab46-976673d7e7b5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:54.109487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1141/2275] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:54.114178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5716342-9d22-403c-bdc4-5d37b988a056 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:54.126240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5716342-9d22-403c-bdc4-5d37b988a056 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:54.132172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d3e67-be0c-41de-9dad-be6e817badc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:54.132946 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d3e67-be0c-41de-9dad-be6e817badc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:54.133359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d3e67-be0c-41de-9dad-be6e817badc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:54.133931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d3e67-be0c-41de-9dad-be6e817badc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:54.134464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d3e67-be0c-41de-9dad-be6e817badc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:54.136196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d3e67-be0c-41de-9dad-be6e817badc6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:54.147421 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1135/2276] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:54.151633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905bfb2-ff68-476a-ab46-976673d7e7b5 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:54.167771 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905bfb2-ff68-476a-ab46-976673d7e7b5 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:54.175421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f306382-5bb2-4844-8af0-5ec849fb353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:54.181060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f306382-5bb2-4844-8af0-5ec849fb353b admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:54.181359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f306382-5bb2-4844-8af0-5ec849fb353b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:54.181646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f306382-5bb2-4844-8af0-5ec849fb353b admin admin] PATH_INFO: `/v3/projects/e845e49de66b4f65a63b28921976f010/users/0cc546e3ced04041a83ce637a1f01bac/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:54.200484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d3e67-be0c-41de-9dad-be6e817badc6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:54.203586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f306382-5bb2-4844-8af0-5ec849fb353b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e845e49de66b4f65a63b28921976f010, user_id=0cc546e3ced04041a83ce637a1f01bac, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:54.212815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5d0d3e67-be0c-41de-9dad-be6e817badc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:54.218554 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f306382-5bb2-4844-8af0-5ec849fb353b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:54.234178 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d3e67-be0c-41de-9dad-be6e817badc6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:54.246097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:54.247690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:54.249005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1142/2277] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:54 2022] PUT /identity/v3/projects/e845e49de66b4f65a63b28921976f010/users/0cc546e3ced04041a83ce637a1f01bac/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:54.251500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:54.253712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] PATH_INFO: `/v3/projects/fb6613f7c75848e3b4a3ef62d402ead8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:54.255269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6613f7c75848e3b4a3ef62d402ead8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:54.256137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433066a-4586-45c0-b913-8a09cb2bbcf2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:54.256634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433066a-4586-45c0-b913-8a09cb2bbcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:54.257285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:54.257879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433066a-4586-45c0-b913-8a09cb2bbcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:54.296610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-2433066a-4586-45c0-b913-8a09cb2bbcf2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:54.297866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2433066a-4586-45c0-b913-8a09cb2bbcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:54.314877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:54.331132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6613f7c75848e3b4a3ef62d402ead8', 'request_id': 'req-a17efc09-247c-4d2d-baba-215317d25077'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.339778 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6613f7c75848e3b4a3ef62d402ead8', 'request_id': 'req-a17efc09-247c-4d2d-baba-215317d25077'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.359656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6613f7c75848e3b4a3ef62d402ead8', 'request_id': 'req-a17efc09-247c-4d2d-baba-215317d25077'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.373366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] The token cache is being invalidate because project fb6613f7c75848e3b4a3ef62d402ead8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:54.375320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.376078 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.378814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1136/2278] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:54 2022] DELETE /identity/v3/projects/fb6613f7c75848e3b4a3ef62d402ead8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:54.382725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:54.385590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:54.408704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:54.413120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1143/2279] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:54.425902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433066a-4586-45c0-b913-8a09cb2bbcf2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:54.428705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2433066a-4586-45c0-b913-8a09cb2bbcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:54.489015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17efc09-247c-4d2d-baba-215317d25077 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:54.495695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:54.496908 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:54.497531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:54.497815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] PATH_INFO: `/v3/users/4f793da8ba3d4dfda0c6b97c1e0eac01` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:54.499122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f793da8ba3d4dfda0c6b97c1e0eac01)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:54.501152 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:54.510838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433066a-4586-45c0-b913-8a09cb2bbcf2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:54.571791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f793da8ba3d4dfda0c6b97c1e0eac01'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.578376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844b31-a58f-43c1-af86-c6e6ab71ea6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:54.579484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844b31-a58f-43c1-af86-c6e6ab71ea6d service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:54.579966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844b31-a58f-43c1-af86-c6e6ab71ea6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:54.580199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844b31-a58f-43c1-af86-c6e6ab71ea6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:54.585929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f793da8ba3d4dfda0c6b97c1e0eac01'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.594076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b844b31-a58f-43c1-af86-c6e6ab71ea6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:54.596455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b844b31-a58f-43c1-af86-c6e6ab71ea6d service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:54.605511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f793da8ba3d4dfda0c6b97c1e0eac01'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.606880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f793da8ba3d4dfda0c6b97c1e0eac01'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.607788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-e8b98cad-6008-4bf4-82ef-6e68ba1ac4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f793da8ba3d4dfda0c6b97c1e0eac01'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:54.609387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1144/2280] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:54.625171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1137/2281] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:54 2022] DELETE /identity/v3/users/4f793da8ba3d4dfda0c6b97c1e0eac01 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:55.155205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844b31-a58f-43c1-af86-c6e6ab71ea6d service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:55.167738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844b31-a58f-43c1-af86-c6e6ab71ea6d service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:55.244523 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:55.245485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.245849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.246199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] PATH_INFO: `/v3/projects/a77e4c62308e4893a0dc76640ccaf9a6` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.247490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77e4c62308e4893a0dc76640ccaf9a6)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:55.249541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:55.278385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:55.319138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77e4c62308e4893a0dc76640ccaf9a6', 'request_id': 'req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:55.328239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77e4c62308e4893a0dc76640ccaf9a6', 'request_id': 'req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:55.336265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77e4c62308e4893a0dc76640ccaf9a6', 'request_id': 'req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:55.350676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] The token cache is being invalidate because project a77e4c62308e4893a0dc76640ccaf9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:55.350968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:55.351601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-19230f9a-3db5-4cd6-a810-52e0f9dcb26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:55.353191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1145/2282] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:55 2022] DELETE /identity/v3/projects/a77e4c62308e4893a0dc76640ccaf9a6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:55.359137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e089c90-767f-4f63-89f1-50081fd36e7a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.359437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e089c90-767f-4f63-89f1-50081fd36e7a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.359725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e089c90-767f-4f63-89f1-50081fd36e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.384826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5e089c90-767f-4f63-89f1-50081fd36e7a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:55.386093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5e089c90-767f-4f63-89f1-50081fd36e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:55.466354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1138/2283] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:55.479036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14605502-c9ba-4742-958b-f1c495b447cb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.479435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14605502-c9ba-4742-958b-f1c495b447cb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.479956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14605502-c9ba-4742-958b-f1c495b447cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.498627 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-14605502-c9ba-4742-958b-f1c495b447cb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:55.499968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-14605502-c9ba-4742-958b-f1c495b447cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:55.510207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1146/2284] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:55.514896 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e089c90-767f-4f63-89f1-50081fd36e7a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:55.527001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e089c90-767f-4f63-89f1-50081fd36e7a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:55.534294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f36eea-bca7-482e-b6e7-04891bf443b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:55.535504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36eea-bca7-482e-b6e7-04891bf443b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.535733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36eea-bca7-482e-b6e7-04891bf443b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.536113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36eea-bca7-482e-b6e7-04891bf443b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.536948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f36eea-bca7-482e-b6e7-04891bf443b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:55.537285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f36eea-bca7-482e-b6e7-04891bf443b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:55.539235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f36eea-bca7-482e-b6e7-04891bf443b3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:55.560664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1139/2285] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:13:55.560992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14605502-c9ba-4742-958b-f1c495b447cb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:55.570947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14605502-c9ba-4742-958b-f1c495b447cb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:55.577632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0d797-0bc6-4da9-8690-0f5143ffcd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:55.578337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0d797-0bc6-4da9-8690-0f5143ffcd28 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.578626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0d797-0bc6-4da9-8690-0f5143ffcd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.578952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0d797-0bc6-4da9-8690-0f5143ffcd28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.579749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0d797-0bc6-4da9-8690-0f5143ffcd28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:55.582136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0d797-0bc6-4da9-8690-0f5143ffcd28 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:55.601089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d3536-f8d4-40c6-8519-bf6139a5b556 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.601605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d3536-f8d4-40c6-8519-bf6139a5b556 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.601845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d3536-f8d4-40c6-8519-bf6139a5b556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.624022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1147/2286] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:55 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:55.626809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0d797-0bc6-4da9-8690-0f5143ffcd28 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:55.667943 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7b1d3536-f8d4-40c6-8519-bf6139a5b556 None None] MFA Rules not processed for user `0cc546e3ced04041a83ce637a1f01bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:55.669262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7b1d3536-f8d4-40c6-8519-bf6139a5b556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:55.686771 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:55.759252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0d797-0bc6-4da9-8690-0f5143ffcd28 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:55.783258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd57a-66c1-43fb-b15e-723bc7239f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:55.785216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd57a-66c1-43fb-b15e-723bc7239f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.786356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd57a-66c1-43fb-b15e-723bc7239f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.795093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd57a-66c1-43fb-b15e-723bc7239f5d admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.795093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd57a-66c1-43fb-b15e-723bc7239f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:55.795093 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd57a-66c1-43fb-b15e-723bc7239f5d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:55.840557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1140/2287] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:55.841174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1148/2288] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:55 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:55.844072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d3536-f8d4-40c6-8519-bf6139a5b556 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:55.850547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd57a-66c1-43fb-b15e-723bc7239f5d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:55.852977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ed7cd57a-66c1-43fb-b15e-723bc7239f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:55.860037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d3536-f8d4-40c6-8519-bf6139a5b556 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:55.870275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0cb79-e2da-4d56-a768-9cba44cc8d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:55.870998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0cb79-e2da-4d56-a768-9cba44cc8d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.871298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0cb79-e2da-4d56-a768-9cba44cc8d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.871581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0cb79-e2da-4d56-a768-9cba44cc8d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.872651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0cb79-e2da-4d56-a768-9cba44cc8d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:55.875997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0cb79-e2da-4d56-a768-9cba44cc8d62 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:55.886952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1141/2289] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:13:55.892653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0cb79-e2da-4d56-a768-9cba44cc8d62 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:55.904810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0cb79-e2da-4d56-a768-9cba44cc8d62 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:55.911661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55336ca8-4014-4067-b9c6-184e33b37916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:55.912510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55336ca8-4014-4067-b9c6-184e33b37916 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.912890 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55336ca8-4014-4067-b9c6-184e33b37916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.913262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55336ca8-4014-4067-b9c6-184e33b37916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.914102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55336ca8-4014-4067-b9c6-184e33b37916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:55.916014 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55336ca8-4014-4067-b9c6-184e33b37916 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:55.928351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1142/2290] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:55.932753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55336ca8-4014-4067-b9c6-184e33b37916 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:55.956806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55336ca8-4014-4067-b9c6-184e33b37916 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:55.961041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd57a-66c1-43fb-b15e-723bc7239f5d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:55.968703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af66f-7b48-4772-9799-c2aaeb56485f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:55.969472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af66f-7b48-4772-9799-c2aaeb56485f service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.969762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af66f-7b48-4772-9799-c2aaeb56485f service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.970063 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af66f-7b48-4772-9799-c2aaeb56485f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.971478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4acfef-f067-44d7-8229-51a0f4544c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:55.972653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4acfef-f067-44d7-8229-51a0f4544c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:55.973229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4acfef-f067-44d7-8229-51a0f4544c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:55.973708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4acfef-f067-44d7-8229-51a0f4544c4b admin admin] PATH_INFO: `/v3/projects/d10f127954d74142ab53d40f5839037e/users/6e8ef39858ee4ef3bd7a09532009d84e/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:55.984409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af66f-7b48-4772-9799-c2aaeb56485f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:55.985892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af66f-7b48-4772-9799-c2aaeb56485f service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:55.995116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4acfef-f067-44d7-8229-51a0f4544c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10f127954d74142ab53d40f5839037e, user_id=6e8ef39858ee4ef3bd7a09532009d84e, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:55.997459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1149/2291] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:13:56.000504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4acfef-f067-44d7-8229-51a0f4544c4b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:56.041856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1143/2292] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:55 2022] PUT /identity/v3/projects/d10f127954d74142ab53d40f5839037e/users/6e8ef39858ee4ef3bd7a09532009d84e/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:13:56.043926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0f2aa-60aa-4f66-89ac-9448ab75a989 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:56.044242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0f2aa-60aa-4f66-89ac-9448ab75a989 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:56.044626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0f2aa-60aa-4f66-89ac-9448ab75a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:56.069603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:56.083804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-cca0f2aa-60aa-4f66-89ac-9448ab75a989 None None] MFA Rules not processed for user `6e8ef39858ee4ef3bd7a09532009d84e`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:56.092932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cca0f2aa-60aa-4f66-89ac-9448ab75a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:56.211769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1150/2293] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:56.228616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4acfef-f067-44d7-8229-51a0f4544c4b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:56.231691 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6f4acfef-f067-44d7-8229-51a0f4544c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:56.297340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4acfef-f067-44d7-8229-51a0f4544c4b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:56.301182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487352a0-9083-48ae-bba1-b90e2ba9976d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:56.305879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487352a0-9083-48ae-bba1-b90e2ba9976d service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:56.305879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487352a0-9083-48ae-bba1-b90e2ba9976d service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:56.305879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487352a0-9083-48ae-bba1-b90e2ba9976d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:56.319812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487352a0-9083-48ae-bba1-b90e2ba9976d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:56.321625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487352a0-9083-48ae-bba1-b90e2ba9976d service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:56.336214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1144/2294] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:56.356123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0f2aa-60aa-4f66-89ac-9448ab75a989 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:56.431955 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0f2aa-60aa-4f66-89ac-9448ab75a989 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:56.443602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:56.444540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:56.444833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:56.445119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] PATH_INFO: `/v3/users/6e8ef39858ee4ef3bd7a09532009d84e` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:56.446357 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8ef39858ee4ef3bd7a09532009d84e)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:56.448520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:56.505819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8ef39858ee4ef3bd7a09532009d84e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:56.514106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8ef39858ee4ef3bd7a09532009d84e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:56.514807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8ef39858ee4ef3bd7a09532009d84e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:56.528117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8ef39858ee4ef3bd7a09532009d84e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:56.528770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8ef39858ee4ef3bd7a09532009d84e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:56.541519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1151/2295] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:13:56 2022] DELETE /identity/v3/users/6e8ef39858ee4ef3bd7a09532009d84e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:56.546060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecb79d-579d-4202-bfa1-0a656faba335 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:56.546355 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecb79d-579d-4202-bfa1-0a656faba335 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:56.546636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecb79d-579d-4202-bfa1-0a656faba335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:56.564020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9cecb79d-579d-4202-bfa1-0a656faba335 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:56.565215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9cecb79d-579d-4202-bfa1-0a656faba335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:56.623616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1145/2296] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:56.633228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:56.634619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:56.657184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:56.694605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b68101-bd6f-4db6-9a20-7775e362eb4d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:56.698220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6672d9-6ba5-4be9-8152-eb43a97d7886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:56.698874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6672d9-6ba5-4be9-8152-eb43a97d7886 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:56.699157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6672d9-6ba5-4be9-8152-eb43a97d7886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:56.699429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6672d9-6ba5-4be9-8152-eb43a97d7886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:56.710097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6672d9-6ba5-4be9-8152-eb43a97d7886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:56.711506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6672d9-6ba5-4be9-8152-eb43a97d7886 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:56.722820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1152/2297] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:13:57.025185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecb79d-579d-4202-bfa1-0a656faba335 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:57.026623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9cecb79d-579d-4202-bfa1-0a656faba335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:57.049621 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecb79d-579d-4202-bfa1-0a656faba335 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:57.063413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:57.067661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.067661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.067661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] PATH_INFO: `/v3/projects/d10f127954d74142ab53d40f5839037e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.068791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10f127954d74142ab53d40f5839037e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:57.070746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:57.072513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:57.131147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10f127954d74142ab53d40f5839037e', 'request_id': 'req-1091532d-6ef3-42da-b4f0-32ff07ef8276'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:57.141377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10f127954d74142ab53d40f5839037e', 'request_id': 'req-1091532d-6ef3-42da-b4f0-32ff07ef8276'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:57.153261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10f127954d74142ab53d40f5839037e', 'request_id': 'req-1091532d-6ef3-42da-b4f0-32ff07ef8276'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:57.166907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] The token cache is being invalidate because project d10f127954d74142ab53d40f5839037e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:13:57.167196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:57.167852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1091532d-6ef3-42da-b4f0-32ff07ef8276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:13:57.169550 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1146/2298] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:13:57 2022] DELETE /identity/v3/projects/d10f127954d74142ab53d40f5839037e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:57.176261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531a50-421e-40d7-9846-9caf733d74ec None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.177214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531a50-421e-40d7-9846-9caf733d74ec None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.177214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531a50-421e-40d7-9846-9caf733d74ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.208561 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-11531a50-421e-40d7-9846-9caf733d74ec None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:57.209793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-11531a50-421e-40d7-9846-9caf733d74ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:57.293725 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1153/2299] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:57.302265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dea2f-c42f-40c1-b8a0-670265701da4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.302559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dea2f-c42f-40c1-b8a0-670265701da4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.302836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dea2f-c42f-40c1-b8a0-670265701da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.323020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-398dea2f-c42f-40c1-b8a0-670265701da4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:57.325113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-398dea2f-c42f-40c1-b8a0-670265701da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:57.335408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1147/2300] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:57.339655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11531a50-421e-40d7-9846-9caf733d74ec None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:57.349986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11531a50-421e-40d7-9846-9caf733d74ec None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:57.355027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064762f8-5c6d-43a1-8f9a-7b5bf030c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:57.355820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064762f8-5c6d-43a1-8f9a-7b5bf030c395 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.356225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064762f8-5c6d-43a1-8f9a-7b5bf030c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.356569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064762f8-5c6d-43a1-8f9a-7b5bf030c395 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.357472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064762f8-5c6d-43a1-8f9a-7b5bf030c395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:13:57.357845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064762f8-5c6d-43a1-8f9a-7b5bf030c395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:57.359520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064762f8-5c6d-43a1-8f9a-7b5bf030c395 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:57.379933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1154/2301] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:13:57.381497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dea2f-c42f-40c1-b8a0-670265701da4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:57.395826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dea2f-c42f-40c1-b8a0-670265701da4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:57.401130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf083f-6fe3-41d9-b7d0-ba5814c138d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:57.401827 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf083f-6fe3-41d9-b7d0-ba5814c138d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.402116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf083f-6fe3-41d9-b7d0-ba5814c138d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.402402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf083f-6fe3-41d9-b7d0-ba5814c138d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.403109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf083f-6fe3-41d9-b7d0-ba5814c138d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:57.405112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf083f-6fe3-41d9-b7d0-ba5814c138d8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:57.477927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1148/2302] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:57 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:13:57.479088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064762f8-5c6d-43a1-8f9a-7b5bf030c395 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:57.495096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064762f8-5c6d-43a1-8f9a-7b5bf030c395 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:57.546376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0e28f-4dff-46c3-adda-dd6aea88037a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.546680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0e28f-4dff-46c3-adda-dd6aea88037a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.546995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0e28f-4dff-46c3-adda-dd6aea88037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.568700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ccd0e28f-4dff-46c3-adda-dd6aea88037a None None] MFA Rules not processed for user `0cc546e3ced04041a83ce637a1f01bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:57.570139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ccd0e28f-4dff-46c3-adda-dd6aea88037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:57.575842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e871f-e3fd-42b8-b6c3-cefff011cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:57.577092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e871f-e3fd-42b8-b6c3-cefff011cbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.577385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e871f-e3fd-42b8-b6c3-cefff011cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.577780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e871f-e3fd-42b8-b6c3-cefff011cbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.578370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e871f-e3fd-42b8-b6c3-cefff011cbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:57.580884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e871f-e3fd-42b8-b6c3-cefff011cbb3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:57.613027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1155/2303] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:57 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:57.614237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e871f-e3fd-42b8-b6c3-cefff011cbb3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:57.625222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e871f-e3fd-42b8-b6c3-cefff011cbb3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:57.631145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8feb4a-a9d6-49e0-82db-332df4213f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:57.632099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8feb4a-a9d6-49e0-82db-332df4213f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.632594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8feb4a-a9d6-49e0-82db-332df4213f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.632987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8feb4a-a9d6-49e0-82db-332df4213f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.633750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8feb4a-a9d6-49e0-82db-332df4213f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:57.635338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8feb4a-a9d6-49e0-82db-332df4213f76 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:57.640651 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1149/2304] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:13:57.647113 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1156/2305] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:13:57.650970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0e28f-4dff-46c3-adda-dd6aea88037a None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:57.664713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0e28f-4dff-46c3-adda-dd6aea88037a None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:57.684294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a19c2-8e7c-4ffb-be7c-ad7df2c80945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:57.684294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a19c2-8e7c-4ffb-be7c-ad7df2c80945 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.684294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a19c2-8e7c-4ffb-be7c-ad7df2c80945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.684294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a19c2-8e7c-4ffb-be7c-ad7df2c80945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.684862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a19c2-8e7c-4ffb-be7c-ad7df2c80945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:57.686163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a19c2-8e7c-4ffb-be7c-ad7df2c80945 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:57.698292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1150/2306] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:57.702607 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8feb4a-a9d6-49e0-82db-332df4213f76 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:57.713250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8feb4a-a9d6-49e0-82db-332df4213f76 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:57.718075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b16a-959f-4f37-8a27-9cae2df17993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:57.718969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b16a-959f-4f37-8a27-9cae2df17993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.719329 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b16a-959f-4f37-8a27-9cae2df17993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.719703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b16a-959f-4f37-8a27-9cae2df17993 admin admin] PATH_INFO: `/v3/projects/71265487a3a1450b856b9f39dc6add43/users/6adbc5950fb14382baa93117abb266e1/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.740021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34b16a-959f-4f37-8a27-9cae2df17993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71265487a3a1450b856b9f39dc6add43, user_id=6adbc5950fb14382baa93117abb266e1, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:57.742707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34b16a-959f-4f37-8a27-9cae2df17993 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:57.756342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1157/2307] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:57 2022] PUT /identity/v3/projects/71265487a3a1450b856b9f39dc6add43/users/6adbc5950fb14382baa93117abb266e1/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:57.767275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271460a0-ed48-44d3-a3a4-4fb3cb450226 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.767639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271460a0-ed48-44d3-a3a4-4fb3cb450226 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.768022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271460a0-ed48-44d3-a3a4-4fb3cb450226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.804290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-271460a0-ed48-44d3-a3a4-4fb3cb450226 None None] MFA Rules not processed for user `6adbc5950fb14382baa93117abb266e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:57.805658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-271460a0-ed48-44d3-a3a4-4fb3cb450226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:57.859224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:57.890643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1151/2308] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:57.896114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b16a-959f-4f37-8a27-9cae2df17993 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:57.903194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:57.979838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b16a-959f-4f37-8a27-9cae2df17993 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:57.985215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cb79c-7ea2-4e19-bc11-365e7faf7268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:57.986124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb79c-7ea2-4e19-bc11-365e7faf7268 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:57.986892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb79c-7ea2-4e19-bc11-365e7faf7268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:57.987181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb79c-7ea2-4e19-bc11-365e7faf7268 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:57.988026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cb79c-7ea2-4e19-bc11-365e7faf7268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:57.990066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cb79c-7ea2-4e19-bc11-365e7faf7268 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:58.018693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1158/2309] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:13:57 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:58.022844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271460a0-ed48-44d3-a3a4-4fb3cb450226 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:58.035794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271460a0-ed48-44d3-a3a4-4fb3cb450226 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:58.094418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec90c0-405f-49d6-b5ca-a87d1fbbd2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:58.096273 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec90c0-405f-49d6-b5ca-a87d1fbbd2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:58.096660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec90c0-405f-49d6-b5ca-a87d1fbbd2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:58.097010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec90c0-405f-49d6-b5ca-a87d1fbbd2d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:58.097783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec90c0-405f-49d6-b5ca-a87d1fbbd2d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:58.099859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec90c0-405f-49d6-b5ca-a87d1fbbd2d5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:58.124900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1152/2310] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:13:58 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:13:58.129043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cb79c-7ea2-4e19-bc11-365e7faf7268 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:58.139721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cb79c-7ea2-4e19-bc11-365e7faf7268 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:58.147175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f0613-24a5-4db2-b1a9-bc166a772643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:58.147877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0613-24a5-4db2-b1a9-bc166a772643 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:58.148234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0613-24a5-4db2-b1a9-bc166a772643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:58.148596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0613-24a5-4db2-b1a9-bc166a772643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:58.149471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f0613-24a5-4db2-b1a9-bc166a772643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:58.151234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f0613-24a5-4db2-b1a9-bc166a772643 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:58.166049 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1159/2311] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:13:58.171775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec90c0-405f-49d6-b5ca-a87d1fbbd2d5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:58.191515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec90c0-405f-49d6-b5ca-a87d1fbbd2d5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:58.199180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b431fd0-e321-425d-a61c-ec5ee2fb184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:58.200176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431fd0-e321-425d-a61c-ec5ee2fb184a admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:58.200468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431fd0-e321-425d-a61c-ec5ee2fb184a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:58.200753 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431fd0-e321-425d-a61c-ec5ee2fb184a admin admin] PATH_INFO: `/v3/projects/90e625cfe1c44b8c88efde789719d8b7/users/8a809b86c17b4900ae26c499943f99bf/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:58.226004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b431fd0-e321-425d-a61c-ec5ee2fb184a admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e625cfe1c44b8c88efde789719d8b7, user_id=8a809b86c17b4900ae26c499943f99bf, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:58.228338 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b431fd0-e321-425d-a61c-ec5ee2fb184a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:58.249339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1153/2312] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:58 2022] PUT /identity/v3/projects/90e625cfe1c44b8c88efde789719d8b7/users/8a809b86c17b4900ae26c499943f99bf/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:58.252772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f0613-24a5-4db2-b1a9-bc166a772643 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:58.268240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f0613-24a5-4db2-b1a9-bc166a772643 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:58.364849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a6bd7-e78f-4d30-ad32-38fe69d5d7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:58.365546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a6bd7-e78f-4d30-ad32-38fe69d5d7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:58.365843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a6bd7-e78f-4d30-ad32-38fe69d5d7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:58.366129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a6bd7-e78f-4d30-ad32-38fe69d5d7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:58.368505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a6bd7-e78f-4d30-ad32-38fe69d5d7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:58.371138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a6bd7-e78f-4d30-ad32-38fe69d5d7a4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:58.389140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b431fd0-e321-425d-a61c-ec5ee2fb184a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:58.391204 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1160/2313] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:13:58.404882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b431fd0-e321-425d-a61c-ec5ee2fb184a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:58.412036 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82a5bd-1a9c-4688-8f14-94217c14c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:58.413170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82a5bd-1a9c-4688-8f14-94217c14c9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:58.415988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82a5bd-1a9c-4688-8f14-94217c14c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:58.417552 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82a5bd-1a9c-4688-8f14-94217c14c9f2 admin admin] PATH_INFO: `/v3/projects/90e625cfe1c44b8c88efde789719d8b7/users/8a809b86c17b4900ae26c499943f99bf/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:58.420760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82a5bd-1a9c-4688-8f14-94217c14c9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e625cfe1c44b8c88efde789719d8b7, user_id=8a809b86c17b4900ae26c499943f99bf, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:58.424096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82a5bd-1a9c-4688-8f14-94217c14c9f2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:58.436901 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1154/2314] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:13:58 2022] PUT /identity/v3/projects/90e625cfe1c44b8c88efde789719d8b7/users/8a809b86c17b4900ae26c499943f99bf/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:13:58.447861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369675be-ea3b-4c77-8b5a-ceb69172e001 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:58.448196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369675be-ea3b-4c77-8b5a-ceb69172e001 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:58.448472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369675be-ea3b-4c77-8b5a-ceb69172e001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:58.480814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-369675be-ea3b-4c77-8b5a-ceb69172e001 None None] MFA Rules not processed for user `8a809b86c17b4900ae26c499943f99bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:13:58.482150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-369675be-ea3b-4c77-8b5a-ceb69172e001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:58.563621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1161/2315] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:13:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:13:58.565596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:58.576781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82a5bd-1a9c-4688-8f14-94217c14c9f2 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:13:58.578793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6a82a5bd-1a9c-4688-8f14-94217c14c9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:13:58.652626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82a5bd-1a9c-4688-8f14-94217c14c9f2 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:13:58.657087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a540c-ca10-4681-8c68-5c2f3c876655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:13:58.658576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a540c-ca10-4681-8c68-5c2f3c876655 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:13:58.659029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a540c-ca10-4681-8c68-5c2f3c876655 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:13:58.659364 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a540c-ca10-4681-8c68-5c2f3c876655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:13:58.711554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:13:58.726039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a540c-ca10-4681-8c68-5c2f3c876655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:13:58.727485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a540c-ca10-4681-8c68-5c2f3c876655 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:13:58.737038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1155/2316] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:13:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:01.370906 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369675be-ea3b-4c77-8b5a-ceb69172e001 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:01.438169 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369675be-ea3b-4c77-8b5a-ceb69172e001 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:01.443506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:01.444423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:01.444709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:01.445042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] PATH_INFO: `/v3/users/6adbc5950fb14382baa93117abb266e1` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:01.446452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adbc5950fb14382baa93117abb266e1)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:01.449025 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:01.509790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adbc5950fb14382baa93117abb266e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:01.517883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adbc5950fb14382baa93117abb266e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:01.518642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adbc5950fb14382baa93117abb266e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:01.530168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adbc5950fb14382baa93117abb266e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:01.530789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adbc5950fb14382baa93117abb266e1'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:01.543868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1162/2317] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:14:01 2022] DELETE /identity/v3/users/6adbc5950fb14382baa93117abb266e1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:01.548981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fc9ac-710e-4f15-b775-5ec09cce0f4e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:01.549506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fc9ac-710e-4f15-b775-5ec09cce0f4e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:01.549603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fc9ac-710e-4f15-b775-5ec09cce0f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:01.568000 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7f6fc9ac-710e-4f15-b775-5ec09cce0f4e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:01.569206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7f6fc9ac-710e-4f15-b775-5ec09cce0f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:01.633397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1156/2318] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:01.644251 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:01.645671 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:01.716226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925328-a981-4404-b691-c5c4591071e3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:01.720531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9ea2-29e1-4b07-95a7-efa3d84fcac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:01.721432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9ea2-29e1-4b07-95a7-efa3d84fcac7 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:01.721717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9ea2-29e1-4b07-95a7-efa3d84fcac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:01.722021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9ea2-29e1-4b07-95a7-efa3d84fcac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:01.732575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a9ea2-29e1-4b07-95a7-efa3d84fcac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:01.734330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a9ea2-29e1-4b07-95a7-efa3d84fcac7 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:01.749961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1163/2319] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:02.099026 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fc9ac-710e-4f15-b775-5ec09cce0f4e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:02.100888 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7f6fc9ac-710e-4f15-b775-5ec09cce0f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:02.123883 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fc9ac-710e-4f15-b775-5ec09cce0f4e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:02.151663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:02.151663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:02.151663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:02.151663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] PATH_INFO: `/v3/projects/71265487a3a1450b856b9f39dc6add43` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:02.153596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71265487a3a1450b856b9f39dc6add43)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:02.158113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:02.215275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71265487a3a1450b856b9f39dc6add43', 'request_id': 'req-7d6fbc02-a507-44de-95d3-e684279e8648'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.221988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71265487a3a1450b856b9f39dc6add43', 'request_id': 'req-7d6fbc02-a507-44de-95d3-e684279e8648'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.229600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71265487a3a1450b856b9f39dc6add43', 'request_id': 'req-7d6fbc02-a507-44de-95d3-e684279e8648'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.241639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] The token cache is being invalidate because project 71265487a3a1450b856b9f39dc6add43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:14:02.241928 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.242569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.244131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1157/2320] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:14:02 2022] DELETE /identity/v3/projects/71265487a3a1450b856b9f39dc6add43 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:02.248139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9ea2-29e1-4b07-95a7-efa3d84fcac7 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:02.265429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9ea2-29e1-4b07-95a7-efa3d84fcac7 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:02.287475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:02.334412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:02.335375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:02.335723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:02.336103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] PATH_INFO: `/v3/users/8a809b86c17b4900ae26c499943f99bf` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:02.337354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a809b86c17b4900ae26c499943f99bf)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:02.339348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:02.391606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a809b86c17b4900ae26c499943f99bf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.399766 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a809b86c17b4900ae26c499943f99bf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.400463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a809b86c17b4900ae26c499943f99bf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.419077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a809b86c17b4900ae26c499943f99bf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.420001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a809b86c17b4900ae26c499943f99bf'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:02.437975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1164/2321] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:14:02 2022] DELETE /identity/v3/users/8a809b86c17b4900ae26c499943f99bf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:14:02.619084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:02.621136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:02.686610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbc02-a507-44de-95d3-e684279e8648 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:02.726355 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:02.750201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa63a6-8500-47d5-ad46-14325eea2438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:02.750865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa63a6-8500-47d5-ad46-14325eea2438 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:02.751200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa63a6-8500-47d5-ad46-14325eea2438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:02.751640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa63a6-8500-47d5-ad46-14325eea2438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:02.755971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d2fa63a6-8500-47d5-ad46-14325eea2438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:02.809086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:02.810597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:02.869134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa63a6-8500-47d5-ad46-14325eea2438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:02.870671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa63a6-8500-47d5-ad46-14325eea2438 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:02.882334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1158/2322] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:02.896713 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994fe8d-2afe-4c52-af79-7ca3fc21529b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:02.901385 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:02.902424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:02.902691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:02.902983 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] PATH_INFO: `/v3/projects/90e625cfe1c44b8c88efde789719d8b7` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:02.904250 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e625cfe1c44b8c88efde789719d8b7)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:02.906175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:03.085106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:03.089622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e625cfe1c44b8c88efde789719d8b7', 'request_id': 'req-57510c92-874e-44a0-88bc-5b60a2fbbc7e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:03.104426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e625cfe1c44b8c88efde789719d8b7', 'request_id': 'req-57510c92-874e-44a0-88bc-5b60a2fbbc7e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:03.121441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e625cfe1c44b8c88efde789719d8b7', 'request_id': 'req-57510c92-874e-44a0-88bc-5b60a2fbbc7e'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:03.136288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] The token cache is being invalidate because project 90e625cfe1c44b8c88efde789719d8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:14:03.136882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:03.138324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-57510c92-874e-44a0-88bc-5b60a2fbbc7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:03.143952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1165/2323] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:14:02 2022] DELETE /identity/v3/projects/90e625cfe1c44b8c88efde789719d8b7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:03.145647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e17e0-f0b1-4a1d-b2f6-4a7d53212b37 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.145950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e17e0-f0b1-4a1d-b2f6-4a7d53212b37 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.146299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e17e0-f0b1-4a1d-b2f6-4a7d53212b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.167134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c63e17e0-f0b1-4a1d-b2f6-4a7d53212b37 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:03.168619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c63e17e0-f0b1-4a1d-b2f6-4a7d53212b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:03.274824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1159/2324] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:14:03.283334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651faf-f97f-41a4-b56c-29ca29eb0ddb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.283726 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651faf-f97f-41a4-b56c-29ca29eb0ddb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.284102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651faf-f97f-41a4-b56c-29ca29eb0ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.305541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-4c651faf-f97f-41a4-b56c-29ca29eb0ddb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:03.306753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4c651faf-f97f-41a4-b56c-29ca29eb0ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:03.314828 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1166/2325] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:03.319261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e17e0-f0b1-4a1d-b2f6-4a7d53212b37 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:03.329686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e17e0-f0b1-4a1d-b2f6-4a7d53212b37 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:03.335085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca4973-9465-40ec-afc3-5f3b4e533608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:03.335650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca4973-9465-40ec-afc3-5f3b4e533608 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.335961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca4973-9465-40ec-afc3-5f3b4e533608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.336244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca4973-9465-40ec-afc3-5f3b4e533608 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.337083 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca4973-9465-40ec-afc3-5f3b4e533608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:14:03.337499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca4973-9465-40ec-afc3-5f3b4e533608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:03.339161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca4973-9465-40ec-afc3-5f3b4e533608 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:03.356344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1160/2326] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:14:03.357418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651faf-f97f-41a4-b56c-29ca29eb0ddb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:03.368682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651faf-f97f-41a4-b56c-29ca29eb0ddb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:03.374970 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b6717-17c2-4d07-8dfb-7d6c493d79d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:03.376142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b6717-17c2-4d07-8dfb-7d6c493d79d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.376863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b6717-17c2-4d07-8dfb-7d6c493d79d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.377100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b6717-17c2-4d07-8dfb-7d6c493d79d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.377797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b6717-17c2-4d07-8dfb-7d6c493d79d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:03.379807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b6717-17c2-4d07-8dfb-7d6c493d79d2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:03.410526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1167/2327] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:14:03 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:14:03.414811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca4973-9465-40ec-afc3-5f3b4e533608 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:03.426835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca4973-9465-40ec-afc3-5f3b4e533608 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:03.504674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798be48-6df3-4482-9545-20d000e5405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:03.505421 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798be48-6df3-4482-9545-20d000e5405d admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.505705 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798be48-6df3-4482-9545-20d000e5405d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.506269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798be48-6df3-4482-9545-20d000e5405d admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.506747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798be48-6df3-4482-9545-20d000e5405d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:03.509063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798be48-6df3-4482-9545-20d000e5405d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:03.526701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:03.536086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1161/2328] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:14:03 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:14:03.538762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b6717-17c2-4d07-8dfb-7d6c493d79d2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:03.549492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b6717-17c2-4d07-8dfb-7d6c493d79d2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:03.554061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88ac7-5b9d-49e4-b67d-372d94578245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:03.554718 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88ac7-5b9d-49e4-b67d-372d94578245 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.555000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88ac7-5b9d-49e4-b67d-372d94578245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.555276 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88ac7-5b9d-49e4-b67d-372d94578245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.556343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d88ac7-5b9d-49e4-b67d-372d94578245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:03.559146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d88ac7-5b9d-49e4-b67d-372d94578245 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:03.570002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1168/2329] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:03.574034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798be48-6df3-4482-9545-20d000e5405d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:03.585329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798be48-6df3-4482-9545-20d000e5405d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:03.590267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf67569-8f2f-4bea-9cb4-5277c30d6e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:03.590938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf67569-8f2f-4bea-9cb4-5277c30d6e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.591227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf67569-8f2f-4bea-9cb4-5277c30d6e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.593627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf67569-8f2f-4bea-9cb4-5277c30d6e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.594415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf67569-8f2f-4bea-9cb4-5277c30d6e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:03.596881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf67569-8f2f-4bea-9cb4-5277c30d6e65 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:03.607589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1162/2330] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:03.612248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88ac7-5b9d-49e4-b67d-372d94578245 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:03.623682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88ac7-5b9d-49e4-b67d-372d94578245 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:03.629045 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d922713-83c4-49e9-8998-c49e6c5385c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:03.630033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d922713-83c4-49e9-8998-c49e6c5385c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.630388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d922713-83c4-49e9-8998-c49e6c5385c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.630736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d922713-83c4-49e9-8998-c49e6c5385c5 admin admin] PATH_INFO: `/v3/projects/aa67a22bb1804f3ca948835df3148a5c/users/bd7635380e1742ecb02c639eb3114a50/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.646884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d922713-83c4-49e9-8998-c49e6c5385c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa67a22bb1804f3ca948835df3148a5c, user_id=bd7635380e1742ecb02c639eb3114a50, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:03.649691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d922713-83c4-49e9-8998-c49e6c5385c5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:03.663485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1169/2331] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:14:03 2022] PUT /identity/v3/projects/aa67a22bb1804f3ca948835df3148a5c/users/bd7635380e1742ecb02c639eb3114a50/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:14:03.675127 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c57c8-6381-4cd7-9a3f-f7579aa77365 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.675648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c57c8-6381-4cd7-9a3f-f7579aa77365 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.675816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c57c8-6381-4cd7-9a3f-f7579aa77365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.703379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a78c57c8-6381-4cd7-9a3f-f7579aa77365 None None] MFA Rules not processed for user `bd7635380e1742ecb02c639eb3114a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:03.704735 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a78c57c8-6381-4cd7-9a3f-f7579aa77365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:03.779218 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1163/2332] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:03.791751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d922713-83c4-49e9-8998-c49e6c5385c5 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:03.793541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6d922713-83c4-49e9-8998-c49e6c5385c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:03.869797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d922713-83c4-49e9-8998-c49e6c5385c5 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:03.878758 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546c377-8be2-47ff-84f3-ba5ccc61e6e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:03.879470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c377-8be2-47ff-84f3-ba5ccc61e6e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:03.879738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c377-8be2-47ff-84f3-ba5ccc61e6e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:03.880172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c377-8be2-47ff-84f3-ba5ccc61e6e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:03.892195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c377-8be2-47ff-84f3-ba5ccc61e6e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:03.894707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c377-8be2-47ff-84f3-ba5ccc61e6e3 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:03.905288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1170/2333] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:13.779409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=38 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:13.900827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=61,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:17.020575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c57c8-6381-4cd7-9a3f-f7579aa77365 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:17.022944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a78c57c8-6381-4cd7-9a3f-f7579aa77365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:17.118507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c57c8-6381-4cd7-9a3f-f7579aa77365 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:17.126186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:17.127409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:17.127409 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:17.127605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] PATH_INFO: `/v3/users/ed857957b6854897b2e75d8604bb6b96` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:17.129930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed857957b6854897b2e75d8604bb6b96)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:17.131099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:17.184496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed857957b6854897b2e75d8604bb6b96'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.192526 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed857957b6854897b2e75d8604bb6b96'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.207516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed857957b6854897b2e75d8604bb6b96'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.208230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed857957b6854897b2e75d8604bb6b96'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.208834 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed857957b6854897b2e75d8604bb6b96'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.221598 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1164/2334] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:14:17 2022] DELETE /identity/v3/users/ed857957b6854897b2e75d8604bb6b96 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:17.226246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282bab-582c-4c95-9444-2d70fd68577e None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:17.226743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282bab-582c-4c95-9444-2d70fd68577e None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:17.226846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282bab-582c-4c95-9444-2d70fd68577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:17.247677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ff282bab-582c-4c95-9444-2d70fd68577e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:17.249050 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ff282bab-582c-4c95-9444-2d70fd68577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:17.307005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1171/2335] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:17.316572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:17.317967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:17.376229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee16ddd-88cb-4bc4-9283-ce0c5a4213d3 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:17.379865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15dc69-a4ad-4467-a27f-ea031e964fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:17.380541 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15dc69-a4ad-4467-a27f-ea031e964fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:17.380832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15dc69-a4ad-4467-a27f-ea031e964fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:17.381112 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15dc69-a4ad-4467-a27f-ea031e964fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:17.390158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15dc69-a4ad-4467-a27f-ea031e964fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:17.392664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15dc69-a4ad-4467-a27f-ea031e964fcd service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:17.402743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1165/2336] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:17.753715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282bab-582c-4c95-9444-2d70fd68577e None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:17.755640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ff282bab-582c-4c95-9444-2d70fd68577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:17.769439 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15dc69-a4ad-4467-a27f-ea031e964fcd service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:17.770833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ef15dc69-a4ad-4467-a27f-ea031e964fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:17.771428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282bab-582c-4c95-9444-2d70fd68577e None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:17.777112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:17.778079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:17.778370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:17.778650 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] PATH_INFO: `/v3/users/bd7635380e1742ecb02c639eb3114a50` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:17.780003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7635380e1742ecb02c639eb3114a50)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:17.782859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:17.794868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15dc69-a4ad-4467-a27f-ea031e964fcd service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:17.807860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:17.808764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:17.809047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:17.809327 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] PATH_INFO: `/v3/projects/75bb0d579e1044cbadb84860f43235a1` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:17.810520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bb0d579e1044cbadb84860f43235a1)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:17.813289 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:17.836101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:17.846814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7635380e1742ecb02c639eb3114a50'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.857791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7635380e1742ecb02c639eb3114a50'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.858811 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7635380e1742ecb02c639eb3114a50'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.875755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7635380e1742ecb02c639eb3114a50'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.876478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-eeb3b047-479b-4526-9e37-b704cabdc437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7635380e1742ecb02c639eb3114a50'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.879396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bb0d579e1044cbadb84860f43235a1', 'request_id': 'req-55542cc9-95c6-4558-bb02-30a0fcf40e3f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.886833 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bb0d579e1044cbadb84860f43235a1', 'request_id': 'req-55542cc9-95c6-4558-bb02-30a0fcf40e3f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.891589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1172/2337] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:14:17 2022] DELETE /identity/v3/users/bd7635380e1742ecb02c639eb3114a50 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:17.896556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bb0d579e1044cbadb84860f43235a1', 'request_id': 'req-55542cc9-95c6-4558-bb02-30a0fcf40e3f'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.896797 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe43c17-fe62-439d-be75-453a0e4505df None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:17.897120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe43c17-fe62-439d-be75-453a0e4505df None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:17.897463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe43c17-fe62-439d-be75-453a0e4505df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:17.910092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] The token cache is being invalidate because project 75bb0d579e1044cbadb84860f43235a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:14:17.910688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.911603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-55542cc9-95c6-4558-bb02-30a0fcf40e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:17.913538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1166/2338] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:14:17 2022] DELETE /identity/v3/projects/75bb0d579e1044cbadb84860f43235a1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:17.918747 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa54015-7ee0-4463-a601-d3512f207c07 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:17.919039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa54015-7ee0-4463-a601-d3512f207c07 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:17.919319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa54015-7ee0-4463-a601-d3512f207c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:17.919702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3fe43c17-fe62-439d-be75-453a0e4505df None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:17.921459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3fe43c17-fe62-439d-be75-453a0e4505df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:17.945355 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3fa54015-7ee0-4463-a601-d3512f207c07 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:17.946604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3fa54015-7ee0-4463-a601-d3512f207c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:17.984273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1173/2339] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:17.994577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe43c17-fe62-439d-be75-453a0e4505df None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:17.995960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3fe43c17-fe62-439d-be75-453a0e4505df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:18.010433 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:18.017544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1167/2340] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:14:18.020372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141511-6c90-421d-9686-8ff64818d0f5 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.020666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141511-6c90-421d-9686-8ff64818d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.021242 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141511-6c90-421d-9686-8ff64818d0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.040532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-98141511-6c90-421d-9686-8ff64818d0f5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:18.041746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-98141511-6c90-421d-9686-8ff64818d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:18.050512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1168/2341] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:18.054652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141511-6c90-421d-9686-8ff64818d0f5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.060268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe43c17-fe62-439d-be75-453a0e4505df None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.063992 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677d6aa-27fa-4771-a2bd-daf5a98b4c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.064768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677d6aa-27fa-4771-a2bd-daf5a98b4c5c service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.064902 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141511-6c90-421d-9686-8ff64818d0f5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.065088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677d6aa-27fa-4771-a2bd-daf5a98b4c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.065327 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677d6aa-27fa-4771-a2bd-daf5a98b4c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.069543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe132a3-4b99-420c-88a3-12f7fc81a53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.070195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe132a3-4b99-420c-88a3-12f7fc81a53d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.070514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe132a3-4b99-420c-88a3-12f7fc81a53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.070788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe132a3-4b99-420c-88a3-12f7fc81a53d admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.071518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe132a3-4b99-420c-88a3-12f7fc81a53d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:14:18.071808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe132a3-4b99-420c-88a3-12f7fc81a53d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.073453 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe132a3-4b99-420c-88a3-12f7fc81a53d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.076296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677d6aa-27fa-4771-a2bd-daf5a98b4c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.078354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677d6aa-27fa-4771-a2bd-daf5a98b4c5c service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.087114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1169/2342] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:14:18.097169 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1174/2343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:18.097451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe132a3-4b99-420c-88a3-12f7fc81a53d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.102349 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe132a3-4b99-420c-88a3-12f7fc81a53d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.114028 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450f91-a8fa-41a6-b4e5-dd2ddcedcb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.114720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450f91-a8fa-41a6-b4e5-dd2ddcedcb80 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.115188 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450f91-a8fa-41a6-b4e5-dd2ddcedcb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.115475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450f91-a8fa-41a6-b4e5-dd2ddcedcb80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.116229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450f91-a8fa-41a6-b4e5-dd2ddcedcb80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.118182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450f91-a8fa-41a6-b4e5-dd2ddcedcb80 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.149655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1170/2344] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:14:18 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:14:18.154085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677d6aa-27fa-4771-a2bd-daf5a98b4c5c service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.168540 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677d6aa-27fa-4771-a2bd-daf5a98b4c5c service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.251886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06dcf-3714-4010-a500-9d0d96eaf90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.252951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06dcf-3714-4010-a500-9d0d96eaf90e admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.253298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06dcf-3714-4010-a500-9d0d96eaf90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.253790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06dcf-3714-4010-a500-9d0d96eaf90e admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.254590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06dcf-3714-4010-a500-9d0d96eaf90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.256887 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06dcf-3714-4010-a500-9d0d96eaf90e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.295947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1175/2345] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:14:18 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:14:18.299992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450f91-a8fa-41a6-b4e5-dd2ddcedcb80 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.333814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450f91-a8fa-41a6-b4e5-dd2ddcedcb80 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.340768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09579fc2-3e18-4832-8159-ee7ab086b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.341486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09579fc2-3e18-4832-8159-ee7ab086b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.341837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09579fc2-3e18-4832-8159-ee7ab086b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.342182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09579fc2-3e18-4832-8159-ee7ab086b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.343148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09579fc2-3e18-4832-8159-ee7ab086b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.345038 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09579fc2-3e18-4832-8159-ee7ab086b9eb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.362094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1171/2346] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:18.366304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06dcf-3714-4010-a500-9d0d96eaf90e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.381388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06dcf-3714-4010-a500-9d0d96eaf90e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.386416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb167264-d984-4618-b051-6a7aab6af392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.387237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb167264-d984-4618-b051-6a7aab6af392 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.387619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb167264-d984-4618-b051-6a7aab6af392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.388344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb167264-d984-4618-b051-6a7aab6af392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.389199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb167264-d984-4618-b051-6a7aab6af392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.391632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb167264-d984-4618-b051-6a7aab6af392 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.402918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1176/2347] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:18.407582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09579fc2-3e18-4832-8159-ee7ab086b9eb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.418760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09579fc2-3e18-4832-8159-ee7ab086b9eb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.425189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad4417-d2b0-4eb4-83c5-03e5689a817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.426167 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad4417-d2b0-4eb4-83c5-03e5689a817b admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.426544 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad4417-d2b0-4eb4-83c5-03e5689a817b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.426897 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad4417-d2b0-4eb4-83c5-03e5689a817b admin admin] PATH_INFO: `/v3/projects/34c64ddf17274e7791b7eac22e2d39a7/users/988bc41a703140dea1319bd327b0eafb/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.444213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad4417-d2b0-4eb4-83c5-03e5689a817b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c64ddf17274e7791b7eac22e2d39a7, user_id=988bc41a703140dea1319bd327b0eafb, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.447004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad4417-d2b0-4eb4-83c5-03e5689a817b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.463404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1172/2348] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:14:18 2022] PUT /identity/v3/projects/34c64ddf17274e7791b7eac22e2d39a7/users/988bc41a703140dea1319bd327b0eafb/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:18.474838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b6773-5071-4fb6-9f88-a3fa3563f571 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.475127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b6773-5071-4fb6-9f88-a3fa3563f571 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.475295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad4417-d2b0-4eb4-83c5-03e5689a817b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.475470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b6773-5071-4fb6-9f88-a3fa3563f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.477314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-37ad4417-d2b0-4eb4-83c5-03e5689a817b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:18.510924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-720b6773-5071-4fb6-9f88-a3fa3563f571 None None] MFA Rules not processed for user `988bc41a703140dea1319bd327b0eafb`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:18.512247 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-720b6773-5071-4fb6-9f88-a3fa3563f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:18.523095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:18.567601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad4417-d2b0-4eb4-83c5-03e5689a817b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.573149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.574186 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.574485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.574761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] PATH_INFO: `/v3/projects/aa67a22bb1804f3ca948835df3148a5c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.575995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa67a22bb1804f3ca948835df3148a5c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.577986 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.596346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1177/2349] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:14:18.607948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b6773-5071-4fb6-9f88-a3fa3563f571 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.609375 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-720b6773-5071-4fb6-9f88-a3fa3563f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:18.646590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:18.654802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa67a22bb1804f3ca948835df3148a5c', 'request_id': 'req-1db61711-4edf-44f1-8851-238ddd10b2f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:18.663326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa67a22bb1804f3ca948835df3148a5c', 'request_id': 'req-1db61711-4edf-44f1-8851-238ddd10b2f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:18.671808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa67a22bb1804f3ca948835df3148a5c', 'request_id': 'req-1db61711-4edf-44f1-8851-238ddd10b2f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:18.684110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] The token cache is being invalidate because project aa67a22bb1804f3ca948835df3148a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:14:18.684458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:18.684954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b6773-5071-4fb6-9f88-a3fa3563f571 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.685140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-1db61711-4edf-44f1-8851-238ddd10b2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:18.686932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1173/2350] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:14:18 2022] DELETE /identity/v3/projects/aa67a22bb1804f3ca948835df3148a5c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:14:18.693197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c813b-5b3d-4673-b562-50356e0312ec None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.693500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c813b-5b3d-4673-b562-50356e0312ec None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.693817 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c813b-5b3d-4673-b562-50356e0312ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.713104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0e8c813b-5b3d-4673-b562-50356e0312ec None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:18.714351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0e8c813b-5b3d-4673-b562-50356e0312ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:18.748486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d3342-4d7d-45fe-9552-1f5a87ef85bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.749165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3342-4d7d-45fe-9552-1f5a87ef85bc service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.749453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3342-4d7d-45fe-9552-1f5a87ef85bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.749735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3342-4d7d-45fe-9552-1f5a87ef85bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.751879 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ba2d3342-4d7d-45fe-9552-1f5a87ef85bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:18.791268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1174/2351] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:18.793333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b0c20-0419-44d1-b5ec-20dc6854afcc None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.793910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b0c20-0419-44d1-b5ec-20dc6854afcc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.794287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b0c20-0419-44d1-b5ec-20dc6854afcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.820744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d3342-4d7d-45fe-9552-1f5a87ef85bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.822197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d3342-4d7d-45fe-9552-1f5a87ef85bc service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.822942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-678b0c20-0419-44d1-b5ec-20dc6854afcc None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:18.824589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-678b0c20-0419-44d1-b5ec-20dc6854afcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:18.832150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1178/2352] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:14:18.846096 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d3342-4d7d-45fe-9552-1f5a87ef85bc service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.852559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1175/2353] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:14:18.858819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d3342-4d7d-45fe-9552-1f5a87ef85bc service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.864366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81866a54-fd9a-4f5f-8051-158da6b53ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.865108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81866a54-fd9a-4f5f-8051-158da6b53ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.865531 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81866a54-fd9a-4f5f-8051-158da6b53ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.865872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81866a54-fd9a-4f5f-8051-158da6b53ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.866666 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81866a54-fd9a-4f5f-8051-158da6b53ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:14:18.867038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81866a54-fd9a-4f5f-8051-158da6b53ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.868880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81866a54-fd9a-4f5f-8051-158da6b53ac3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.881214 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1179/2354] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:14:18.885376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b0c20-0419-44d1-b5ec-20dc6854afcc None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.895404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b0c20-0419-44d1-b5ec-20dc6854afcc None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:18.900159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f716e9-c7b0-4cde-8762-fbf7322ef345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:18.900813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f716e9-c7b0-4cde-8762-fbf7322ef345 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:18.901102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f716e9-c7b0-4cde-8762-fbf7322ef345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:18.901383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f716e9-c7b0-4cde-8762-fbf7322ef345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:18.902076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f716e9-c7b0-4cde-8762-fbf7322ef345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:18.904099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f716e9-c7b0-4cde-8762-fbf7322ef345 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:18.931516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1176/2355] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:14:18 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:14:18.935657 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81866a54-fd9a-4f5f-8051-158da6b53ac3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:18.950102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81866a54-fd9a-4f5f-8051-158da6b53ac3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:19.017277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd86ce3-847a-4119-a3d4-8282493f3ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:19.018239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd86ce3-847a-4119-a3d4-8282493f3ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:19.018882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd86ce3-847a-4119-a3d4-8282493f3ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:19.019321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd86ce3-847a-4119-a3d4-8282493f3ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:19.020212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd86ce3-847a-4119-a3d4-8282493f3ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:19.022283 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd86ce3-847a-4119-a3d4-8282493f3ae3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:19.045211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1180/2356] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:14:18 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:14:19.049807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f716e9-c7b0-4cde-8762-fbf7322ef345 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:19.063087 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f716e9-c7b0-4cde-8762-fbf7322ef345 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:19.068671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44206c4-d638-4b3b-9aa5-cf947d09c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:19.069328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44206c4-d638-4b3b-9aa5-cf947d09c780 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:19.069617 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44206c4-d638-4b3b-9aa5-cf947d09c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:19.069910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44206c4-d638-4b3b-9aa5-cf947d09c780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:19.070653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44206c4-d638-4b3b-9aa5-cf947d09c780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:19.072436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44206c4-d638-4b3b-9aa5-cf947d09c780 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:19.087947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1177/2357] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:19.089468 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd86ce3-847a-4119-a3d4-8282493f3ae3 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:19.111090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd86ce3-847a-4119-a3d4-8282493f3ae3 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:19.125419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c32b41-8fd1-4b30-a5a6-a3beb8408b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:19.126721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c32b41-8fd1-4b30-a5a6-a3beb8408b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:19.127056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c32b41-8fd1-4b30-a5a6-a3beb8408b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:19.128028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c32b41-8fd1-4b30-a5a6-a3beb8408b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:19.130610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c32b41-8fd1-4b30-a5a6-a3beb8408b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:19.133642 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c32b41-8fd1-4b30-a5a6-a3beb8408b74 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:19.150970 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:19.168457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1181/2358] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:19.175938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44206c4-d638-4b3b-9aa5-cf947d09c780 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:19.184455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44206c4-d638-4b3b-9aa5-cf947d09c780 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:19.189358 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f8abc-8a8e-4a0c-aeec-0686e79bc6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:19.190359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f8abc-8a8e-4a0c-aeec-0686e79bc6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:19.190509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f8abc-8a8e-4a0c-aeec-0686e79bc6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:19.190783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f8abc-8a8e-4a0c-aeec-0686e79bc6e5 admin admin] PATH_INFO: `/v3/projects/8ed84dc50cdd49a3a194c3004c79d71d/users/3c39b59b57064d398b15ba83cef56d9c/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:19.206660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f8abc-8a8e-4a0c-aeec-0686e79bc6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed84dc50cdd49a3a194c3004c79d71d, user_id=3c39b59b57064d398b15ba83cef56d9c, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:19.209466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f8abc-8a8e-4a0c-aeec-0686e79bc6e5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:19.213342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:19.227017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1178/2359] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:14:19 2022] PUT /identity/v3/projects/8ed84dc50cdd49a3a194c3004c79d71d/users/3c39b59b57064d398b15ba83cef56d9c/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:14:19.232115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8791af-f49a-4700-af21-a42f5c217d71 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:19.232411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8791af-f49a-4700-af21-a42f5c217d71 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:19.232749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8791af-f49a-4700-af21-a42f5c217d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:19.252396 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-bf8791af-f49a-4700-af21-a42f5c217d71 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:19.253605 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-bf8791af-f49a-4700-af21-a42f5c217d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:19.313035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1182/2360] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:19.322940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f8abc-8a8e-4a0c-aeec-0686e79bc6e5 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:19.324649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-411f8abc-8a8e-4a0c-aeec-0686e79bc6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:19.386752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f8abc-8a8e-4a0c-aeec-0686e79bc6e5 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:19.390348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57866b-5967-496a-bb39-76786f86087b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:19.392316 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57866b-5967-496a-bb39-76786f86087b service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:19.392616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57866b-5967-496a-bb39-76786f86087b service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:19.392907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57866b-5967-496a-bb39-76786f86087b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:19.402229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57866b-5967-496a-bb39-76786f86087b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:19.404234 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57866b-5967-496a-bb39-76786f86087b service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:19.414003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1179/2361] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:14:21.904507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc687ce-29f2-4bb8-9864-51992534899c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:21.905055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc687ce-29f2-4bb8-9864-51992534899c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:21.905055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc687ce-29f2-4bb8-9864-51992534899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:21.923805 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1fc687ce-29f2-4bb8-9864-51992534899c None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:21.925060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1fc687ce-29f2-4bb8-9864-51992534899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:21.985035 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1183/2362] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:14:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:22.002378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57866b-5967-496a-bb39-76786f86087b service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:22.004767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1a57866b-5967-496a-bb39-76786f86087b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:22.093469 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57866b-5967-496a-bb39-76786f86087b service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:22.099821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addebb86-7456-45f9-ac5b-09959c9ae8ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:22.100587 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebb86-7456-45f9-ac5b-09959c9ae8ac service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:22.100879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebb86-7456-45f9-ac5b-09959c9ae8ac service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:22.101156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebb86-7456-45f9-ac5b-09959c9ae8ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:22.114282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addebb86-7456-45f9-ac5b-09959c9ae8ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:22.117965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addebb86-7456-45f9-ac5b-09959c9ae8ac service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:22.138841 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1180/2363] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:14:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:14:22.272826 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc687ce-29f2-4bb8-9864-51992534899c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:22.275968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1fc687ce-29f2-4bb8-9864-51992534899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:22.297074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc687ce-29f2-4bb8-9864-51992534899c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:22.309439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:22.310646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:22.311080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:22.311506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] PATH_INFO: `/v3/users/988bc41a703140dea1319bd327b0eafb` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:22.313915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988bc41a703140dea1319bd327b0eafb)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:22.316134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:22.434547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988bc41a703140dea1319bd327b0eafb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:22.460062 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988bc41a703140dea1319bd327b0eafb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:22.460725 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988bc41a703140dea1319bd327b0eafb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:22.492305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988bc41a703140dea1319bd327b0eafb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:22.500898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988bc41a703140dea1319bd327b0eafb'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:22.545420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1184/2364] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:14:22 2022] DELETE /identity/v3/users/988bc41a703140dea1319bd327b0eafb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:22.571484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a231-d6dd-4919-b413-d2fae6be4ad9 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:22.572200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a231-d6dd-4919-b413-d2fae6be4ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:22.572682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a231-d6dd-4919-b413-d2fae6be4ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:22.617600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a255a231-d6dd-4919-b413-d2fae6be4ad9 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:22.619361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a255a231-d6dd-4919-b413-d2fae6be4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:22.806337 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1181/2365] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:22.819948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:22.823707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:22.872556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:22.947826 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fcd56-5fcb-4135-b89d-82e65e0b0769 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:22.956336 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37c1d4-2685-4ba0-a575-6e6357a71f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:22.957968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37c1d4-2685-4ba0-a575-6e6357a71f18 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:22.958617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37c1d4-2685-4ba0-a575-6e6357a71f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:22.959071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37c1d4-2685-4ba0-a575-6e6357a71f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:22.986767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37c1d4-2685-4ba0-a575-6e6357a71f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:23.002596 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37c1d4-2685-4ba0-a575-6e6357a71f18 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:23.028779 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1185/2366] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:24.059911 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a231-d6dd-4919-b413-d2fae6be4ad9 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:24.061352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a255a231-d6dd-4919-b413-d2fae6be4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:24.086484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a231-d6dd-4919-b413-d2fae6be4ad9 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:24.096654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:24.097714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:24.097992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:24.098276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] PATH_INFO: `/v3/projects/34c64ddf17274e7791b7eac22e2d39a7` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:24.100288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c64ddf17274e7791b7eac22e2d39a7)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:24.102238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:24.166603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:24.215250 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c64ddf17274e7791b7eac22e2d39a7', 'request_id': 'req-6d332d30-85ac-4d54-ae60-dfd91aff82a7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:24.227564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c64ddf17274e7791b7eac22e2d39a7', 'request_id': 'req-6d332d30-85ac-4d54-ae60-dfd91aff82a7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:24.249137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c64ddf17274e7791b7eac22e2d39a7', 'request_id': 'req-6d332d30-85ac-4d54-ae60-dfd91aff82a7'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:24.269975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] The token cache is being invalidate because project 34c64ddf17274e7791b7eac22e2d39a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:14:24.270273 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:24.272247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d332d30-85ac-4d54-ae60-dfd91aff82a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:14:24.277659 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1182/2367] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:14:24 2022] DELETE /identity/v3/projects/34c64ddf17274e7791b7eac22e2d39a7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:24.280555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6f917-2226-4c25-ac6f-f19e2311196f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:24.283117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6f917-2226-4c25-ac6f-f19e2311196f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:24.283420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6f917-2226-4c25-ac6f-f19e2311196f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:24.351150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3fe6f917-2226-4c25-ac6f-f19e2311196f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:24.354694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3fe6f917-2226-4c25-ac6f-f19e2311196f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:24.512944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1186/2368] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:24.522497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc420f-7526-499d-9107-b36fcc9ab2c1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:24.522497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc420f-7526-499d-9107-b36fcc9ab2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:24.523521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc420f-7526-499d-9107-b36fcc9ab2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:24.566052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8cdc420f-7526-499d-9107-b36fcc9ab2c1 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:24.568360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8cdc420f-7526-499d-9107-b36fcc9ab2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:24.582768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1183/2369] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:24.587121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6f917-2226-4c25-ac6f-f19e2311196f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:24.603034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6f917-2226-4c25-ac6f-f19e2311196f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:24.624665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a454d-96f7-4913-b282-0b8b239e7d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:24.628867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a454d-96f7-4913-b282-0b8b239e7d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:24.629220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a454d-96f7-4913-b282-0b8b239e7d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:24.631271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a454d-96f7-4913-b282-0b8b239e7d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:24.635989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a454d-96f7-4913-b282-0b8b239e7d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:14:24.638074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a454d-96f7-4913-b282-0b8b239e7d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:24.654712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a454d-96f7-4913-b282-0b8b239e7d0d admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:24.685333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1187/2370] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:14:24.694085 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc420f-7526-499d-9107-b36fcc9ab2c1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:24.713197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc420f-7526-499d-9107-b36fcc9ab2c1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:24.727994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6122-6896-4335-b64e-6186e39387fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:24.728666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6122-6896-4335-b64e-6186e39387fd admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:24.728954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6122-6896-4335-b64e-6186e39387fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:24.729235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6122-6896-4335-b64e-6186e39387fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:24.729939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b6122-6896-4335-b64e-6186e39387fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:24.732041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b6122-6896-4335-b64e-6186e39387fd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:24.797603 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a454d-96f7-4913-b282-0b8b239e7d0d admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:24.805477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1184/2371] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:14:24 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:14:24.809788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a454d-96f7-4913-b282-0b8b239e7d0d admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:24.892000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f9e5d-9c6d-486f-abb2-0ec1b2f1b654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:24.892978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9e5d-9c6d-486f-abb2-0ec1b2f1b654 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:24.893486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9e5d-9c6d-486f-abb2-0ec1b2f1b654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:24.893996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9e5d-9c6d-486f-abb2-0ec1b2f1b654 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:24.895294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9e5d-9c6d-486f-abb2-0ec1b2f1b654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:24.898932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9e5d-9c6d-486f-abb2-0ec1b2f1b654 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:24.972594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6122-6896-4335-b64e-6186e39387fd admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:24.982279 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1188/2372] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:14:24 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:14:24.987124 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6122-6896-4335-b64e-6186e39387fd admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:25.013648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992a154-c872-4e66-9511-d39ddf45e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:25.014443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992a154-c872-4e66-9511-d39ddf45e2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:25.014815 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992a154-c872-4e66-9511-d39ddf45e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:25.015170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992a154-c872-4e66-9511-d39ddf45e2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:25.016612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992a154-c872-4e66-9511-d39ddf45e2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:25.019342 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992a154-c872-4e66-9511-d39ddf45e2bc admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:25.035674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f9e5d-9c6d-486f-abb2-0ec1b2f1b654 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:25.036521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1185/2373] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:25.048284 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f9e5d-9c6d-486f-abb2-0ec1b2f1b654 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:25.053812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabce97d-486d-4923-be9a-1070e7483ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:25.054670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabce97d-486d-4923-be9a-1070e7483ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:25.055024 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabce97d-486d-4923-be9a-1070e7483ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:25.055313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabce97d-486d-4923-be9a-1070e7483ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:25.056208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabce97d-486d-4923-be9a-1070e7483ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:25.058138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabce97d-486d-4923-be9a-1070e7483ec1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:25.076481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992a154-c872-4e66-9511-d39ddf45e2bc admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:25.088280 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1189/2374] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:25.088690 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992a154-c872-4e66-9511-d39ddf45e2bc admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:25.094286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c872b9-afa0-4a0b-930a-644767509b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:25.097972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ed60-6324-4ff6-98e5-22d563f08ccd None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:25.098455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ed60-6324-4ff6-98e5-22d563f08ccd None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:25.099127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ed60-6324-4ff6-98e5-22d563f08ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:25.101948 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c872b9-afa0-4a0b-930a-644767509b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:25.104153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c872b9-afa0-4a0b-930a-644767509b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:25.105419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c872b9-afa0-4a0b-930a-644767509b54 admin admin] PATH_INFO: `/v3/projects/2218ceae41474bc997b355f4042068e8/users/acaf48e745544c0497b5c7f3f41c5143/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:25.157423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5a38ed60-6324-4ff6-98e5-22d563f08ccd None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:25.158683 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5a38ed60-6324-4ff6-98e5-22d563f08ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:25.164814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c872b9-afa0-4a0b-930a-644767509b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2218ceae41474bc997b355f4042068e8, user_id=acaf48e745544c0497b5c7f3f41c5143, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:25.169158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c872b9-afa0-4a0b-930a-644767509b54 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:25.183163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1190/2375] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:25.213670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1186/2376] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:14:25 2022] PUT /identity/v3/projects/2218ceae41474bc997b355f4042068e8/users/acaf48e745544c0497b5c7f3f41c5143/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:25.214581 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88b13a-7b5b-43f3-9099-3b10a6fc9861 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:25.214874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88b13a-7b5b-43f3-9099-3b10a6fc9861 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:25.215159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88b13a-7b5b-43f3-9099-3b10a6fc9861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:25.226245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c872b9-afa0-4a0b-930a-644767509b54 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:25.230376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-84c872b9-afa0-4a0b-930a-644767509b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:25.279866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3f88b13a-7b5b-43f3-9099-3b10a6fc9861 None None] MFA Rules not processed for user `acaf48e745544c0497b5c7f3f41c5143`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:25.284773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3f88b13a-7b5b-43f3-9099-3b10a6fc9861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:25.330597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:25.476698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c872b9-afa0-4a0b-930a-644767509b54 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:25.498198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208512b-c888-48b8-9f5f-4fe0f0cd25aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:25.499311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208512b-c888-48b8-9f5f-4fe0f0cd25aa service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:25.502215 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208512b-c888-48b8-9f5f-4fe0f0cd25aa service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:25.503878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208512b-c888-48b8-9f5f-4fe0f0cd25aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:25.575640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1191/2377] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:25.587187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88b13a-7b5b-43f3-9099-3b10a6fc9861 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:25.588895 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3f88b13a-7b5b-43f3-9099-3b10a6fc9861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:25.628754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:25.658203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208512b-c888-48b8-9f5f-4fe0f0cd25aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:25.664696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208512b-c888-48b8-9f5f-4fe0f0cd25aa service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:25.725160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1187/2378] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:25.775444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88b13a-7b5b-43f3-9099-3b10a6fc9861 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:25.789732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3aebf-d2ab-4988-b348-7baed4207d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:25.790432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3aebf-d2ab-4988-b348-7baed4207d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:25.790724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3aebf-d2ab-4988-b348-7baed4207d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:25.791002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3aebf-d2ab-4988-b348-7baed4207d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:25.818594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3aebf-d2ab-4988-b348-7baed4207d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:25.820081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3aebf-d2ab-4988-b348-7baed4207d5a service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:25.846290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1192/2379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:27.163761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c75d9f-aab7-44f4-8bda-49f2ace381a0 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:27.165373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c75d9f-aab7-44f4-8bda-49f2ace381a0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:27.165667 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c75d9f-aab7-44f4-8bda-49f2ace381a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:27.233256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-28c75d9f-aab7-44f4-8bda-49f2ace381a0 None None] MFA Rules not processed for user `3c39b59b57064d398b15ba83cef56d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:27.243305 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-28c75d9f-aab7-44f4-8bda-49f2ace381a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:27.382921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1188/2380] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:27.387325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3aebf-d2ab-4988-b348-7baed4207d5a service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:27.389225 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-37e3aebf-d2ab-4988-b348-7baed4207d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:27.411951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3aebf-d2ab-4988-b348-7baed4207d5a service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:27.419504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45c067-bbb3-4814-bfac-9465d36d4a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:27.420570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45c067-bbb3-4814-bfac-9465d36d4a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:27.424190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45c067-bbb3-4814-bfac-9465d36d4a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:27.424656 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45c067-bbb3-4814-bfac-9465d36d4a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:27.425543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45c067-bbb3-4814-bfac-9465d36d4a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:27.430187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45c067-bbb3-4814-bfac-9465d36d4a25 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:27.525665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c75d9f-aab7-44f4-8bda-49f2ace381a0 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:27.528002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1193/2381] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:14:27 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:14:27.576134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c75d9f-aab7-44f4-8bda-49f2ace381a0 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:27.650293 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f8a0-4dff-4b64-b407-c671072e9d91 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:27.650981 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f8a0-4dff-4b64-b407-c671072e9d91 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:27.651676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f8a0-4dff-4b64-b407-c671072e9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:27.733107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-45c6f8a0-4dff-4b64-b407-c671072e9d91 None None] MFA Rules not processed for user `acaf48e745544c0497b5c7f3f41c5143`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:27.734558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e4fa6-e470-4047-9e69-21ee703eb0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:27.735573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e4fa6-e470-4047-9e69-21ee703eb0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:27.735997 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e4fa6-e470-4047-9e69-21ee703eb0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:27.736382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e4fa6-e470-4047-9e69-21ee703eb0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:27.737196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e4fa6-e470-4047-9e69-21ee703eb0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:27.740323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-45c6f8a0-4dff-4b64-b407-c671072e9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:27.741591 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e4fa6-e470-4047-9e69-21ee703eb0a1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:27.792953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1189/2382] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:14:27 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:14:27.794110 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e4fa6-e470-4047-9e69-21ee703eb0a1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:27.836462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e4fa6-e470-4047-9e69-21ee703eb0a1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:27.877411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371319a-97aa-4249-98e3-8d57bcbdcb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:27.878229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371319a-97aa-4249-98e3-8d57bcbdcb97 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:27.878643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371319a-97aa-4249-98e3-8d57bcbdcb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:27.879057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371319a-97aa-4249-98e3-8d57bcbdcb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:27.879869 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371319a-97aa-4249-98e3-8d57bcbdcb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:27.881802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371319a-97aa-4249-98e3-8d57bcbdcb97 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:27.911238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1190/2383] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:27.912440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371319a-97aa-4249-98e3-8d57bcbdcb97 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:27.944050 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1194/2384] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:27.944050 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec876-a643-4695-afd6-080be26c24b4 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:27.944050 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec876-a643-4695-afd6-080be26c24b4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:27.944050 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec876-a643-4695-afd6-080be26c24b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:27.946745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371319a-97aa-4249-98e3-8d57bcbdcb97 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:27.954429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8a340-3165-4260-8796-7523cd6639f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:27.955492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8a340-3165-4260-8796-7523cd6639f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:27.956224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8a340-3165-4260-8796-7523cd6639f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:27.956619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8a340-3165-4260-8796-7523cd6639f4 admin admin] PATH_INFO: `/v3/projects/684a2687fe4541bf9cf0e47ecf56f827/users/31be076be56a4cc6ae2ae5a8e7c36569/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:27.978722 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8a340-3165-4260-8796-7523cd6639f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684a2687fe4541bf9cf0e47ecf56f827, user_id=31be076be56a4cc6ae2ae5a8e7c36569, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:27.981816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8a340-3165-4260-8796-7523cd6639f4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:27.985519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-321ec876-a643-4695-afd6-080be26c24b4 None None] MFA Rules not processed for user `966f641526b64cf3aec1744a141a2f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:27.990014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-321ec876-a643-4695-afd6-080be26c24b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:28.023412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1191/2385] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:14:27 2022] PUT /identity/v3/projects/684a2687fe4541bf9cf0e47ecf56f827/users/31be076be56a4cc6ae2ae5a8e7c36569/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:14:28.027161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8a340-3165-4260-8796-7523cd6639f4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:28.088944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:28.092712 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:28.165067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1195/2386] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:28.193755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8a340-3165-4260-8796-7523cd6639f4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:28.206308 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91e9c0-7a55-43d5-8e18-71824f66dbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:28.208346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91e9c0-7a55-43d5-8e18-71824f66dbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:28.209887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91e9c0-7a55-43d5-8e18-71824f66dbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:28.210352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91e9c0-7a55-43d5-8e18-71824f66dbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:28.212021 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91e9c0-7a55-43d5-8e18-71824f66dbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:28.213830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91e9c0-7a55-43d5-8e18-71824f66dbc7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:28.240219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1192/2387] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:14:28.242444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ec876-a643-4695-afd6-080be26c24b4 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:28.259976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ec876-a643-4695-afd6-080be26c24b4 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:28.277043 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421256b3-82e7-4c63-9ad4-f21a94a2390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:28.278277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421256b3-82e7-4c63-9ad4-f21a94a2390b admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:28.278678 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421256b3-82e7-4c63-9ad4-f21a94a2390b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:28.280670 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421256b3-82e7-4c63-9ad4-f21a94a2390b admin admin] PATH_INFO: `/v3/projects/684a2687fe4541bf9cf0e47ecf56f827/users/31be076be56a4cc6ae2ae5a8e7c36569/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:28.291150 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421256b3-82e7-4c63-9ad4-f21a94a2390b admin admin] RBAC: Authorizing `identity:create_grant(project_id=684a2687fe4541bf9cf0e47ecf56f827, user_id=31be076be56a4cc6ae2ae5a8e7c36569, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:28.295288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421256b3-82e7-4c63-9ad4-f21a94a2390b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:28.342871 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1196/2388] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:14:28 2022] PUT /identity/v3/projects/684a2687fe4541bf9cf0e47ecf56f827/users/31be076be56a4cc6ae2ae5a8e7c36569/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:14:31.670868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886126c-31d5-45d6-afa9-0cedef9b43dc None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:31.672106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886126c-31d5-45d6-afa9-0cedef9b43dc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:31.672628 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886126c-31d5-45d6-afa9-0cedef9b43dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:31.717767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3886126c-31d5-45d6-afa9-0cedef9b43dc None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:31.724181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3886126c-31d5-45d6-afa9-0cedef9b43dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:31.866638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1193/2389] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:32.303714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421256b3-82e7-4c63-9ad4-f21a94a2390b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:32.534507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421256b3-82e7-4c63-9ad4-f21a94a2390b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:32.545625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c744c53-853d-416b-9ba6-f6b87f7fb8bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:32.547291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c744c53-853d-416b-9ba6-f6b87f7fb8bc service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:32.547628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c744c53-853d-416b-9ba6-f6b87f7fb8bc service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:32.547853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c744c53-853d-416b-9ba6-f6b87f7fb8bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:32.584802 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c744c53-853d-416b-9ba6-f6b87f7fb8bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:32.589412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c744c53-853d-416b-9ba6-f6b87f7fb8bc service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:32.631007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1197/2390] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:36.131297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4421b8-f29c-4fae-b4b5-29a801b93694 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:36.131849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4421b8-f29c-4fae-b4b5-29a801b93694 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:36.131849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4421b8-f29c-4fae-b4b5-29a801b93694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:36.163150 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4c4421b8-f29c-4fae-b4b5-29a801b93694 None None] MFA Rules not processed for user `0cc546e3ced04041a83ce637a1f01bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:36.165623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4c4421b8-f29c-4fae-b4b5-29a801b93694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:36.336696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1194/2391] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:37.395664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1e90b-5b4c-4412-9cd5-f0e14c1bb912 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:37.396343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1e90b-5b4c-4412-9cd5-f0e14c1bb912 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:37.396343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1e90b-5b4c-4412-9cd5-f0e14c1bb912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:37.435479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-20b1e90b-5b4c-4412-9cd5-f0e14c1bb912 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:37.437492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-20b1e90b-5b4c-4412-9cd5-f0e14c1bb912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:37.522298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1198/2392] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:38.029117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4421b8-f29c-4fae-b4b5-29a801b93694 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:38.032382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4c4421b8-f29c-4fae-b4b5-29a801b93694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:38.067383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4421b8-f29c-4fae-b4b5-29a801b93694 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:38.078611 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d2f86-b164-4e03-a4a1-abb280434ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:38.082590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d2f86-b164-4e03-a4a1-abb280434ab2 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:38.083323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d2f86-b164-4e03-a4a1-abb280434ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:38.083991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d2f86-b164-4e03-a4a1-abb280434ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:38.133562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d2f86-b164-4e03-a4a1-abb280434ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:38.148523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d2f86-b164-4e03-a4a1-abb280434ab2 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:38.212489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1195/2393] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:40.828272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357539b-2779-4beb-a4b6-049aae1b0f30 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:40.829313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357539b-2779-4beb-a4b6-049aae1b0f30 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:40.829852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357539b-2779-4beb-a4b6-049aae1b0f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:40.887434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3357539b-2779-4beb-a4b6-049aae1b0f30 None None] MFA Rules not processed for user `31be076be56a4cc6ae2ae5a8e7c36569`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:40.892426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3357539b-2779-4beb-a4b6-049aae1b0f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:41.060552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1199/2394] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:41.088830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d2f86-b164-4e03-a4a1-abb280434ab2 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:41.105861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d2f86-b164-4e03-a4a1-abb280434ab2 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:41.134702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de1f36-6d88-45e6-9dfd-6c5812b5948f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:41.135970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de1f36-6d88-45e6-9dfd-6c5812b5948f service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:41.136491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de1f36-6d88-45e6-9dfd-6c5812b5948f service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:41.137247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de1f36-6d88-45e6-9dfd-6c5812b5948f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:41.207168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:41.221713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de1f36-6d88-45e6-9dfd-6c5812b5948f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:41.225618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de1f36-6d88-45e6-9dfd-6c5812b5948f service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:41.238241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1196/2395] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:42.647769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82553678-717e-447e-9cef-c844f4a96b69 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:42.648405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82553678-717e-447e-9cef-c844f4a96b69 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:42.648405 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82553678-717e-447e-9cef-c844f4a96b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:42.678921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-82553678-717e-447e-9cef-c844f4a96b69 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:42.681583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-82553678-717e-447e-9cef-c844f4a96b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:42.694086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1200/2396] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:42.718154 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de1f36-6d88-45e6-9dfd-6c5812b5948f service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:42.731790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de1f36-6d88-45e6-9dfd-6c5812b5948f service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:42.738357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6e390-b556-4c18-aaad-d5d1dd5c41ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:42.739671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e390-b556-4c18-aaad-d5d1dd5c41ba service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:42.740153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e390-b556-4c18-aaad-d5d1dd5c41ba service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:42.740577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e390-b556-4c18-aaad-d5d1dd5c41ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:42.753867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6e390-b556-4c18-aaad-d5d1dd5c41ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:42.756034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6e390-b556-4c18-aaad-d5d1dd5c41ba service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:42.771192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1197/2397] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:45.112649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351021-699f-4f9a-9c5b-eb9d3f71e958 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:45.113177 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351021-699f-4f9a-9c5b-eb9d3f71e958 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:45.113281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351021-699f-4f9a-9c5b-eb9d3f71e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:45.174052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-79351021-699f-4f9a-9c5b-eb9d3f71e958 None None] MFA Rules not processed for user `3c39b59b57064d398b15ba83cef56d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:45.175299 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-79351021-699f-4f9a-9c5b-eb9d3f71e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:45.202986 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1201/2398] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:14:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:46.958432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee4f3-dc48-40e6-b154-23513ab3b883 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:46.959480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee4f3-dc48-40e6-b154-23513ab3b883 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:46.960005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee4f3-dc48-40e6-b154-23513ab3b883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:46.979537 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-003ee4f3-dc48-40e6-b154-23513ab3b883 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:46.981496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-003ee4f3-dc48-40e6-b154-23513ab3b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:46.993806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1198/2399] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:47.021260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79351021-699f-4f9a-9c5b-eb9d3f71e958 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:47.042053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79351021-699f-4f9a-9c5b-eb9d3f71e958 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:47.060363 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b552b-5e3a-4220-9ae2-bec1d1c4b153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:47.061516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b552b-5e3a-4220-9ae2-bec1d1c4b153 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:47.062099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b552b-5e3a-4220-9ae2-bec1d1c4b153 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:47.066750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b552b-5e3a-4220-9ae2-bec1d1c4b153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:47.082302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b552b-5e3a-4220-9ae2-bec1d1c4b153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:47.084303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b552b-5e3a-4220-9ae2-bec1d1c4b153 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:47.098527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1202/2400] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:51.194787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd66a4c-0d3b-45ba-a5ba-7c38a02733d6 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:51.195279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd66a4c-0d3b-45ba-a5ba-7c38a02733d6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:51.195279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd66a4c-0d3b-45ba-a5ba-7c38a02733d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:51.213885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-afd66a4c-0d3b-45ba-a5ba-7c38a02733d6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:51.215105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-afd66a4c-0d3b-45ba-a5ba-7c38a02733d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:51.224020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1199/2401] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:51.402238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b552b-5e3a-4220-9ae2-bec1d1c4b153 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:51.407533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:14:51.413025 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b552b-5e3a-4220-9ae2-bec1d1c4b153 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:51.418866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f49f0-29a3-4702-bc38-1d08b47c3d5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:51.419513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f49f0-29a3-4702-bc38-1d08b47c3d5f service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:51.419799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f49f0-29a3-4702-bc38-1d08b47c3d5f service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:51.420142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f49f0-29a3-4702-bc38-1d08b47c3d5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:51.428552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f49f0-29a3-4702-bc38-1d08b47c3d5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:51.430104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f49f0-29a3-4702-bc38-1d08b47c3d5f service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:51.439582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1203/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:14:58.307416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ad0a9-4dd6-4606-beaa-009544135388 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:58.308016 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ad0a9-4dd6-4606-beaa-009544135388 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:58.308412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ad0a9-4dd6-4606-beaa-009544135388 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:58.311539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1200/2403] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:14:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:14:58.327371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770556c-7dfa-417f-8e8b-b3ba740dc403 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:58.327889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770556c-7dfa-417f-8e8b-b3ba740dc403 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:58.328030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770556c-7dfa-417f-8e8b-b3ba740dc403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:58.368836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3770556c-7dfa-417f-8e8b-b3ba740dc403 None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:58.369334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3770556c-7dfa-417f-8e8b-b3ba740dc403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:58.397831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1204/2404] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:58.413473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ad0a9-4dd6-4606-beaa-009544135388 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:58.416190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-293ad0a9-4dd6-4606-beaa-009544135388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:58.492912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ad0a9-4dd6-4606-beaa-009544135388 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:58.501871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dbb18-1318-4ca6-9de2-2cf44473f37f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7d9cfbbcd4068aa9241ffd694c631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:58.502845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dbb18-1318-4ca6-9de2-2cf44473f37f service glance] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:58.503419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dbb18-1318-4ca6-9de2-2cf44473f37f service glance] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:58.503859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dbb18-1318-4ca6-9de2-2cf44473f37f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:58.518102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dbb18-1318-4ca6-9de2-2cf44473f37f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:58.519571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dbb18-1318-4ca6-9de2-2cf44473f37f service glance] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:58.536666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1201/2405] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:58.619735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d157204-43d6-4796-b6f2-0d8ee5deb931 None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:58.620428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d157204-43d6-4796-b6f2-0d8ee5deb931 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:58.620713 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d157204-43d6-4796-b6f2-0d8ee5deb931 None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:58.622242 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1205/2406] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:14:58.633760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c569e-6a35-4285-bb49-d162c211ff36 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:58.634173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c569e-6a35-4285-bb49-d162c211ff36 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:58.634708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c569e-6a35-4285-bb49-d162c211ff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:58.660816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-6a7c569e-6a35-4285-bb49-d162c211ff36 None None] MFA Rules not processed for user `fb227a145fdd44319f5ccbe762409ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:58.662255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6a7c569e-6a35-4285-bb49-d162c211ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:58.751711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1202/2407] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:58.770664 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d157204-43d6-4796-b6f2-0d8ee5deb931 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:58.773927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4d157204-43d6-4796-b6f2-0d8ee5deb931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:58.800575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d157204-43d6-4796-b6f2-0d8ee5deb931 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:58.816630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19a461-6b26-4f77-b083-b1216a992667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:58.817410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19a461-6b26-4f77-b083-b1216a992667 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:58.817933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19a461-6b26-4f77-b083-b1216a992667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:58.818638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19a461-6b26-4f77-b083-b1216a992667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:58.836784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19a461-6b26-4f77-b083-b1216a992667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:58.838218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19a461-6b26-4f77-b083-b1216a992667 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:58.860633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1206/2408] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:14:58.958768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a21b93-1191-4da2-ba9d-41a4743466f2 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:58.958989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a21b93-1191-4da2-ba9d-41a4743466f2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:58.959572 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a21b93-1191-4da2-ba9d-41a4743466f2 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:58.961549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1203/2409] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 22:14:58.969672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926411-6514-41a8-a7a4-bf00a91f0c93 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:58.969964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926411-6514-41a8-a7a4-bf00a91f0c93 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:58.970254 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926411-6514-41a8-a7a4-bf00a91f0c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:59.000936 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1e926411-6514-41a8-a7a4-bf00a91f0c93 None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:14:59.002467 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1e926411-6514-41a8-a7a4-bf00a91f0c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:59.012610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1207/2410] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:14:59.024299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a21b93-1191-4da2-ba9d-41a4743466f2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:14:59.026109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-92a21b93-1191-4da2-ba9d-41a4743466f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:14:59.040432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a21b93-1191-4da2-ba9d-41a4743466f2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:14:59.044025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1b3b7-c889-475d-a6d1-1fc9bea8bd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:14:59.044746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1b3b7-c889-475d-a6d1-1fc9bea8bd94 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:14:59.045020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1b3b7-c889-475d-a6d1-1fc9bea8bd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:14:59.045501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1b3b7-c889-475d-a6d1-1fc9bea8bd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:14:59.056443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1b3b7-c889-475d-a6d1-1fc9bea8bd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:14:59.057952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1b3b7-c889-475d-a6d1-1fc9bea8bd94 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:14:59.070017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1204/2411] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:14:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:15:08.990546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=16 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:09.065163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=71 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:12.313441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e926411-6514-41a8-a7a4-bf00a91f0c93 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:12.314996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1e926411-6514-41a8-a7a4-bf00a91f0c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:12.392185 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e926411-6514-41a8-a7a4-bf00a91f0c93 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:12.397260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:12.397924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:12.398213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:12.398495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:12.400361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:12.412824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:12.414388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:12.424672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1208/2412] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:15:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:15:16.627637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd226be-d5c5-4992-8f44-01a31e38a7bc None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:16.628247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd226be-d5c5-4992-8f44-01a31e38a7bc None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:16.628247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd226be-d5c5-4992-8f44-01a31e38a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:16.668870 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5dd226be-d5c5-4992-8f44-01a31e38a7bc None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:16.670762 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5dd226be-d5c5-4992-8f44-01a31e38a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:16.755639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1205/2413] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:15:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:16.773878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:16.775489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:16.882199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf427a-7fc0-43dd-8fd4-83aaf3f5d8cb service placement] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:16.890005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7a7f8-d63e-420b-a4d1-b0809def3e25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:16.890663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a7f8-d63e-420b-a4d1-b0809def3e25 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:16.891834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a7f8-d63e-420b-a4d1-b0809def3e25 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:16.892334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a7f8-d63e-420b-a4d1-b0809def3e25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:16.902352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7a7f8-d63e-420b-a4d1-b0809def3e25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:16.905750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7a7f8-d63e-420b-a4d1-b0809def3e25 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:16.915930 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1209/2414] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:15:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:15:17.608418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81f62a-db0c-4596-8ef9-e7b10bf2fcd3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:17.608418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81f62a-db0c-4596-8ef9-e7b10bf2fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:17.610678 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81f62a-db0c-4596-8ef9-e7b10bf2fcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:17.655533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1d81f62a-db0c-4596-8ef9-e7b10bf2fcd3 None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:17.656807 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1d81f62a-db0c-4596-8ef9-e7b10bf2fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:17.666508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1206/2415] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:15:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:17.683589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7a7f8-d63e-420b-a4d1-b0809def3e25 service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:17.700980 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7a7f8-d63e-420b-a4d1-b0809def3e25 service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:17.708077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362b93-22b6-4e9e-a9bb-887336bbb74b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:17.709021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362b93-22b6-4e9e-a9bb-887336bbb74b service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:17.709409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362b93-22b6-4e9e-a9bb-887336bbb74b service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:17.709793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362b93-22b6-4e9e-a9bb-887336bbb74b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:17.724877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78362b93-22b6-4e9e-a9bb-887336bbb74b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:17.727484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78362b93-22b6-4e9e-a9bb-887336bbb74b service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:17.742684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cce79-3b1d-49ac-80ee-b8265dc13983 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:17.742981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cce79-3b1d-49ac-80ee-b8265dc13983 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:17.743263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cce79-3b1d-49ac-80ee-b8265dc13983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:17.749668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1210/2416] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:15:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:15:17.793360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f58cce79-3b1d-49ac-80ee-b8265dc13983 None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:17.795256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f58cce79-3b1d-49ac-80ee-b8265dc13983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:17.807784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1207/2417] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 22:15:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:17.877027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362b93-22b6-4e9e-a9bb-887336bbb74b service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:17.897559 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362b93-22b6-4e9e-a9bb-887336bbb74b service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:17.918947 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661d8e2-522d-47f9-acda-0922fd80317b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:17.920557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661d8e2-522d-47f9-acda-0922fd80317b service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:17.921165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661d8e2-522d-47f9-acda-0922fd80317b service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:17.921609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661d8e2-522d-47f9-acda-0922fd80317b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:17.940409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661d8e2-522d-47f9-acda-0922fd80317b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:17.942882 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661d8e2-522d-47f9-acda-0922fd80317b service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:17.954114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1211/2418] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:15:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:15:18.485319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976b621-7efa-4f30-80ae-eb0893bfc3de None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:18.485854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976b621-7efa-4f30-80ae-eb0893bfc3de None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:18.486286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976b621-7efa-4f30-80ae-eb0893bfc3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:18.520963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9976b621-7efa-4f30-80ae-eb0893bfc3de None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:18.524885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9976b621-7efa-4f30-80ae-eb0893bfc3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:18.548377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1208/2419] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:15:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:15:18.575924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661d8e2-522d-47f9-acda-0922fd80317b service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:18.592453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661d8e2-522d-47f9-acda-0922fd80317b service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:18.597952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf27de7-bcd6-4697-9b14-e3688b4639b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:18.598721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27de7-bcd6-4697-9b14-e3688b4639b0 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:18.599085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27de7-bcd6-4697-9b14-e3688b4639b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:18.599586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27de7-bcd6-4697-9b14-e3688b4639b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:18.609106 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf27de7-bcd6-4697-9b14-e3688b4639b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:18.611176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf27de7-bcd6-4697-9b14-e3688b4639b0 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:18.621565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1212/2420] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:15:20.439278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7d055-f66e-4ed9-b716-2c25e11d78ad None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:20.439937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7d055-f66e-4ed9-b716-2c25e11d78ad None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:20.439937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7d055-f66e-4ed9-b716-2c25e11d78ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:20.468578 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cac7d055-f66e-4ed9-b716-2c25e11d78ad None None] MFA Rules not processed for user `6d7eae84d1ac486abd9c59c5adc3b5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:20.470359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cac7d055-f66e-4ed9-b716-2c25e11d78ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:20.571947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1209/2421] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:15:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:28.618497 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=82 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:30.083594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530df33-f4cb-4ce1-9c8e-60af34352493 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:30.084295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530df33-f4cb-4ce1-9c8e-60af34352493 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:30.084295 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530df33-f4cb-4ce1-9c8e-60af34352493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:30.106428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-e530df33-f4cb-4ce1-9c8e-60af34352493 None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:30.108000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e530df33-f4cb-4ce1-9c8e-60af34352493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:30.119406 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1213/2422] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:30.158706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7d055-f66e-4ed9-b716-2c25e11d78ad None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:30.177739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7d055-f66e-4ed9-b716-2c25e11d78ad None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:30.183476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb894-16ba-4880-b9fe-e5b44cad1e8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:30.184382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb894-16ba-4880-b9fe-e5b44cad1e8d service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:30.184831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb894-16ba-4880-b9fe-e5b44cad1e8d service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:30.185137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb894-16ba-4880-b9fe-e5b44cad1e8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:30.199079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb894-16ba-4880-b9fe-e5b44cad1e8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:30.201872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb894-16ba-4880-b9fe-e5b44cad1e8d service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:30.219645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1210/2423] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:15:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:15:30.818286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b49914-4afb-479e-bd5d-401bfbb5117c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:30.818590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b49914-4afb-479e-bd5d-401bfbb5117c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:30.819388 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b49914-4afb-479e-bd5d-401bfbb5117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:30.845336 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-79b49914-4afb-479e-bd5d-401bfbb5117c None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:30.847006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-79b49914-4afb-479e-bd5d-401bfbb5117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:30.855451 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1214/2424] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:30.883654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb894-16ba-4880-b9fe-e5b44cad1e8d service swift] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:30.907967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb894-16ba-4880-b9fe-e5b44cad1e8d service swift] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:30.923944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bad213-70d0-4283-9f90-0766f801f9a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:30.924808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bad213-70d0-4283-9f90-0766f801f9a2 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:30.925202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bad213-70d0-4283-9f90-0766f801f9a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:30.926324 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bad213-70d0-4283-9f90-0766f801f9a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:30.941561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bad213-70d0-4283-9f90-0766f801f9a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:30.944501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bad213-70d0-4283-9f90-0766f801f9a2 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:30.959972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1211/2425] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:15:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:15:33.670095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b49914-4afb-479e-bd5d-401bfbb5117c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:33.686661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b49914-4afb-479e-bd5d-401bfbb5117c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:33.691848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:33.692923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:33.693223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:33.693485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] PATH_INFO: `/v3/users/acaf48e745544c0497b5c7f3f41c5143` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:33.695175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acaf48e745544c0497b5c7f3f41c5143)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:33.697542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:33.773677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acaf48e745544c0497b5c7f3f41c5143'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:33.786501 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acaf48e745544c0497b5c7f3f41c5143'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:33.787178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acaf48e745544c0497b5c7f3f41c5143'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:33.811262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acaf48e745544c0497b5c7f3f41c5143'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:33.813312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acaf48e745544c0497b5c7f3f41c5143'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:33.832275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1215/2426] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:15:33 2022] DELETE /identity/v3/users/acaf48e745544c0497b5c7f3f41c5143 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:15:33.837148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f701a-b5ff-4497-a08f-79c527900a5b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:33.838092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f701a-b5ff-4497-a08f-79c527900a5b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:33.838564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f701a-b5ff-4497-a08f-79c527900a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:33.864485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ea4f701a-b5ff-4497-a08f-79c527900a5b None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:33.866011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ea4f701a-b5ff-4497-a08f-79c527900a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:34.005733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1212/2427] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:34.052308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:34.054086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:34.184033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558ea71-e31c-4797-8dba-a6065bfbb170 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:34.191239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910d66b-bedd-493d-8a13-43481ea0c9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:34.192527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910d66b-bedd-493d-8a13-43481ea0c9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:34.192820 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910d66b-bedd-493d-8a13-43481ea0c9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:34.193116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910d66b-bedd-493d-8a13-43481ea0c9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:34.206957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910d66b-bedd-493d-8a13-43481ea0c9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:34.211337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910d66b-bedd-493d-8a13-43481ea0c9c5 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:34.229961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1216/2428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:15:34.443065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f701a-b5ff-4497-a08f-79c527900a5b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:34.444553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ea4f701a-b5ff-4497-a08f-79c527900a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:34.459414 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:34.463714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f701a-b5ff-4497-a08f-79c527900a5b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:34.471309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:34.472310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:34.472692 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:34.473049 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] PATH_INFO: `/v3/projects/2218ceae41474bc997b355f4042068e8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:34.474348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2218ceae41474bc997b355f4042068e8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:34.476693 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:34.539335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2218ceae41474bc997b355f4042068e8', 'request_id': 'req-dfa6b378-65db-4ced-a67e-c4444a826d80'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:34.546451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2218ceae41474bc997b355f4042068e8', 'request_id': 'req-dfa6b378-65db-4ced-a67e-c4444a826d80'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:34.557497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2218ceae41474bc997b355f4042068e8', 'request_id': 'req-dfa6b378-65db-4ced-a67e-c4444a826d80'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:34.573921 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] The token cache is being invalidate because project 2218ceae41474bc997b355f4042068e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:15:34.574235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:34.575048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-dfa6b378-65db-4ced-a67e-c4444a826d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:34.576932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1213/2429] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:15:34 2022] DELETE /identity/v3/projects/2218ceae41474bc997b355f4042068e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:15:35.416793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910d66b-bedd-493d-8a13-43481ea0c9c5 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:35.418833 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c910d66b-bedd-493d-8a13-43481ea0c9c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:35.441470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910d66b-bedd-493d-8a13-43481ea0c9c5 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:35.520281 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:35.520966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:35.521311 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:35.521606 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:35.523823 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:35.574116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:35.697266 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:35.699519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:35.711218 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1217/2430] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:15:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:15:38.604850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fec01-91af-4463-b47f-e7def4114fce None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:38.605884 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fec01-91af-4463-b47f-e7def4114fce None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:38.606336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fec01-91af-4463-b47f-e7def4114fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:38.625450 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2d3fec01-91af-4463-b47f-e7def4114fce None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:38.626624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2d3fec01-91af-4463-b47f-e7def4114fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:38.707162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1214/2431] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 22:15:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:38.720026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:38.721567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:38.814482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb3fcb-9c3c-4dc9-bd71-caefefc642ed service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:38.821715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb6c50-4a22-46ad-9681-bf43d367ed65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:38.822757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb6c50-4a22-46ad-9681-bf43d367ed65 service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:38.823695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb6c50-4a22-46ad-9681-bf43d367ed65 service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:38.823695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb6c50-4a22-46ad-9681-bf43d367ed65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:38.835803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb6c50-4a22-46ad-9681-bf43d367ed65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:38.838369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb6c50-4a22-46ad-9681-bf43d367ed65 service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:38.856113 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1218/2432] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:15:39.822634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6421-7634-4029-8820-cebc0490b9a3 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:39.823137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6421-7634-4029-8820-cebc0490b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:39.823246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6421-7634-4029-8820-cebc0490b9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:39.842592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7c0b6421-7634-4029-8820-cebc0490b9a3 None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:39.843830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7c0b6421-7634-4029-8820-cebc0490b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:39.852533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1215/2433] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 22:15:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:39.865186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb6c50-4a22-46ad-9681-bf43d367ed65 service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:39.877009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb6c50-4a22-46ad-9681-bf43d367ed65 service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:39.882853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb581c-72fa-4623-9acb-9a180f98a3aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:39.883586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb581c-72fa-4623-9acb-9a180f98a3aa service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:39.883922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb581c-72fa-4623-9acb-9a180f98a3aa service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:39.884210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb581c-72fa-4623-9acb-9a180f98a3aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:39.893528 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb581c-72fa-4623-9acb-9a180f98a3aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:39.895119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb581c-72fa-4623-9acb-9a180f98a3aa service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:39.903471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1219/2434] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:15:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:15:40.882329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6421-7634-4029-8820-cebc0490b9a3 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:40.883752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7c0b6421-7634-4029-8820-cebc0490b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:40.953229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6421-7634-4029-8820-cebc0490b9a3 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:40.957977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:40.958845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:40.959190 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:40.959475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] PATH_INFO: `/v3/users/0cc546e3ced04041a83ce637a1f01bac` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:40.960702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc546e3ced04041a83ce637a1f01bac)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:40.962645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:40.990655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:41.009678 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc546e3ced04041a83ce637a1f01bac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.017414 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc546e3ced04041a83ce637a1f01bac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.030312 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc546e3ced04041a83ce637a1f01bac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.031032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc546e3ced04041a83ce637a1f01bac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.031669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a2e32101-cbc5-4606-b795-491fcd755d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc546e3ced04041a83ce637a1f01bac'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.044226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1216/2435] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:15:40 2022] DELETE /identity/v3/users/0cc546e3ced04041a83ce637a1f01bac => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:15:41.256601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb581c-72fa-4623-9acb-9a180f98a3aa service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:41.267479 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb581c-72fa-4623-9acb-9a180f98a3aa service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:41.337742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:41.338623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.338912 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.339205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] PATH_INFO: `/v3/projects/e845e49de66b4f65a63b28921976f010` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.340658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e845e49de66b4f65a63b28921976f010)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:41.342586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:41.376177 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:41.389310 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e845e49de66b4f65a63b28921976f010', 'request_id': 'req-5d68d664-1df5-499c-84f4-3df7937f6bf6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.395342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e845e49de66b4f65a63b28921976f010', 'request_id': 'req-5d68d664-1df5-499c-84f4-3df7937f6bf6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.400889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e845e49de66b4f65a63b28921976f010', 'request_id': 'req-5d68d664-1df5-499c-84f4-3df7937f6bf6'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.412736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] The token cache is being invalidate because project e845e49de66b4f65a63b28921976f010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:15:41.413073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.413686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d68d664-1df5-499c-84f4-3df7937f6bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:41.415221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1220/2436] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:15:41 2022] DELETE /identity/v3/projects/e845e49de66b4f65a63b28921976f010 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:15:41.420934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1faf5-a014-4c1b-940b-eed330603f11 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.421229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1faf5-a014-4c1b-940b-eed330603f11 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.421511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1faf5-a014-4c1b-940b-eed330603f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.439569 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1ca1faf5-a014-4c1b-940b-eed330603f11 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:41.440922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1ca1faf5-a014-4c1b-940b-eed330603f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:41.498910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1217/2437] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:41.507187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9758-c3e1-4028-8bb2-6afe1aeba7cc None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.507478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9758-c3e1-4028-8bb2-6afe1aeba7cc None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.507760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9758-c3e1-4028-8bb2-6afe1aeba7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.526226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-fa6a9758-c3e1-4028-8bb2-6afe1aeba7cc None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:41.527422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-fa6a9758-c3e1-4028-8bb2-6afe1aeba7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:41.536379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1221/2438] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:41.540489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1faf5-a014-4c1b-940b-eed330603f11 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:41.550185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1faf5-a014-4c1b-940b-eed330603f11 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:41.554674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb30cd6-734d-4474-a331-89d702dda757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:41.555359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb30cd6-734d-4474-a331-89d702dda757 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.555646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb30cd6-734d-4474-a331-89d702dda757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.555947 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb30cd6-734d-4474-a331-89d702dda757 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.556674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb30cd6-734d-4474-a331-89d702dda757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:15:41.556981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb30cd6-734d-4474-a331-89d702dda757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:41.558561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb30cd6-734d-4474-a331-89d702dda757 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:41.570063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1218/2439] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:15:41.574172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a9758-c3e1-4028-8bb2-6afe1aeba7cc None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:41.584344 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a9758-c3e1-4028-8bb2-6afe1aeba7cc None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:41.588958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b505b9b-ba79-4dd5-b55e-e9ebee10f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:41.589604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b505b9b-ba79-4dd5-b55e-e9ebee10f6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.589905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b505b9b-ba79-4dd5-b55e-e9ebee10f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.590162 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b505b9b-ba79-4dd5-b55e-e9ebee10f6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.591053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b505b9b-ba79-4dd5-b55e-e9ebee10f6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:41.592988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b505b9b-ba79-4dd5-b55e-e9ebee10f6d4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:41.622505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1222/2440] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:15:41 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:15:41.624122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb30cd6-734d-4474-a331-89d702dda757 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:41.634309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb30cd6-734d-4474-a331-89d702dda757 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:41.691216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa963b9-95d8-4ab7-8f67-70b090b729d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:41.691919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa963b9-95d8-4ab7-8f67-70b090b729d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.692214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa963b9-95d8-4ab7-8f67-70b090b729d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.692505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa963b9-95d8-4ab7-8f67-70b090b729d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.693200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa963b9-95d8-4ab7-8f67-70b090b729d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:41.695126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa963b9-95d8-4ab7-8f67-70b090b729d4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:41.720297 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1219/2441] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:15:41 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:15:41.721784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b505b9b-ba79-4dd5-b55e-e9ebee10f6d4 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:41.733969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b505b9b-ba79-4dd5-b55e-e9ebee10f6d4 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:41.739997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29230e04-ffc0-4237-8fab-e910baef9886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:41.740774 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29230e04-ffc0-4237-8fab-e910baef9886 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.741080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29230e04-ffc0-4237-8fab-e910baef9886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.741452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29230e04-ffc0-4237-8fab-e910baef9886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.742425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29230e04-ffc0-4237-8fab-e910baef9886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:41.744039 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29230e04-ffc0-4237-8fab-e910baef9886 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:41.756182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1223/2442] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:15:41.760376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa963b9-95d8-4ab7-8f67-70b090b729d4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:41.770869 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa963b9-95d8-4ab7-8f67-70b090b729d4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:41.775512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2396fc7-1bee-4fe7-87b5-c07962c99a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:41.776210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2396fc7-1bee-4fe7-87b5-c07962c99a34 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.776500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2396fc7-1bee-4fe7-87b5-c07962c99a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.776777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2396fc7-1bee-4fe7-87b5-c07962c99a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.777627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2396fc7-1bee-4fe7-87b5-c07962c99a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:41.779975 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2396fc7-1bee-4fe7-87b5-c07962c99a34 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:41.790197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1220/2443] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:15:41.794614 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29230e04-ffc0-4237-8fab-e910baef9886 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:41.805127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29230e04-ffc0-4237-8fab-e910baef9886 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:41.811303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd9f3-9712-4034-bbff-abcf77174ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:41.812384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd9f3-9712-4034-bbff-abcf77174ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.812731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd9f3-9712-4034-bbff-abcf77174ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.813071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd9f3-9712-4034-bbff-abcf77174ad6 admin admin] PATH_INFO: `/v3/projects/ceb122d1e1c34b6284637fe55d6c06f3/users/287f43157d71453797f61b49144f2a59/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.828175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cd9f3-9712-4034-bbff-abcf77174ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb122d1e1c34b6284637fe55d6c06f3, user_id=287f43157d71453797f61b49144f2a59, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:41.831040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cd9f3-9712-4034-bbff-abcf77174ad6 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:41.845261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1224/2444] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:15:41 2022] PUT /identity/v3/projects/ceb122d1e1c34b6284637fe55d6c06f3/users/287f43157d71453797f61b49144f2a59/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:15:41.855405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08e202-4799-47dd-99da-5209c61d03a5 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:41.855724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08e202-4799-47dd-99da-5209c61d03a5 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:41.856047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08e202-4799-47dd-99da-5209c61d03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:41.877079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:41.886629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8c08e202-4799-47dd-99da-5209c61d03a5 None None] MFA Rules not processed for user `287f43157d71453797f61b49144f2a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:41.888083 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8c08e202-4799-47dd-99da-5209c61d03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:41.951301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1221/2445] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:41.962815 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd9f3-9712-4034-bbff-abcf77174ad6 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:41.964517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-092cd9f3-9712-4034-bbff-abcf77174ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:42.022399 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd9f3-9712-4034-bbff-abcf77174ad6 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:42.026108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dbb3c-c65b-4068-a5ff-252f23bb36df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:42.026749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dbb3c-c65b-4068-a5ff-252f23bb36df service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:42.027033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dbb3c-c65b-4068-a5ff-252f23bb36df service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:42.027312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dbb3c-c65b-4068-a5ff-252f23bb36df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:42.036125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dbb3c-c65b-4068-a5ff-252f23bb36df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:42.037538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dbb3c-c65b-4068-a5ff-252f23bb36df service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:42.047584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1225/2446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:15:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:15:47.026280 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08e202-4799-47dd-99da-5209c61d03a5 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:47.088603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08e202-4799-47dd-99da-5209c61d03a5 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:47.093962 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:47.094848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:47.095254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:47.095543 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] PATH_INFO: `/v3/users/287f43157d71453797f61b49144f2a59` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:47.096806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=287f43157d71453797f61b49144f2a59)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:47.098810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:47.156513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287f43157d71453797f61b49144f2a59'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.165613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287f43157d71453797f61b49144f2a59'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.178728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287f43157d71453797f61b49144f2a59'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.179412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287f43157d71453797f61b49144f2a59'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.180045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287f43157d71453797f61b49144f2a59'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.194012 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1222/2447] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:15:47 2022] DELETE /identity/v3/users/287f43157d71453797f61b49144f2a59 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:15:47.198631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f771-6fcc-4d73-8590-77356f764c82 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:47.199108 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f771-6fcc-4d73-8590-77356f764c82 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:47.199319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f771-6fcc-4d73-8590-77356f764c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:47.217672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a199f771-6fcc-4d73-8590-77356f764c82 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:47.219055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a199f771-6fcc-4d73-8590-77356f764c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:47.270439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:47.281588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1226/2448] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:15:47.291138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:47.292559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:47.314748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:15:47.353088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69a286-f2b6-41ef-9f25-e612d4704787 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:47.356743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b6a78-f55e-41f9-bf19-045f9e436998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:47.357375 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b6a78-f55e-41f9-bf19-045f9e436998 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:47.357661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b6a78-f55e-41f9-bf19-045f9e436998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:47.357941 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b6a78-f55e-41f9-bf19-045f9e436998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:47.366992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b6a78-f55e-41f9-bf19-045f9e436998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:47.368459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b6a78-f55e-41f9-bf19-045f9e436998 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:47.377801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1223/2449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:15:47.736252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f771-6fcc-4d73-8590-77356f764c82 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:47.737904 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a199f771-6fcc-4d73-8590-77356f764c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:47.752926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f771-6fcc-4d73-8590-77356f764c82 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:47.757759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:47.758647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:47.758927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:47.759202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] PATH_INFO: `/v3/projects/ceb122d1e1c34b6284637fe55d6c06f3` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:47.760411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb122d1e1c34b6284637fe55d6c06f3)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:47.763081 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:47.812371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb122d1e1c34b6284637fe55d6c06f3', 'request_id': 'req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.819432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb122d1e1c34b6284637fe55d6c06f3', 'request_id': 'req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.826489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb122d1e1c34b6284637fe55d6c06f3', 'request_id': 'req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.841157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] The token cache is being invalidate because project ceb122d1e1c34b6284637fe55d6c06f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:15:47.841499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.842158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:15:47.844152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1227/2450] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:15:47 2022] DELETE /identity/v3/projects/ceb122d1e1c34b6284637fe55d6c06f3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:15:51.383106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2ca71-f3bd-48f6-9894-9851c2ae21f6 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:51.383622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2ca71-f3bd-48f6-9894-9851c2ae21f6 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:51.383622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2ca71-f3bd-48f6-9894-9851c2ae21f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:51.401678 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-94f2ca71-f3bd-48f6-9894-9851c2ae21f6 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:51.402881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-94f2ca71-f3bd-48f6-9894-9851c2ae21f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:51.462174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1224/2451] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:51.526189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:51.527601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:51.603334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d88ab-37e8-46bd-81bc-e7dc88a48f94 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:51.609103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd71bb1-c68e-4787-b083-5fc28f592496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:51.609753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd71bb1-c68e-4787-b083-5fc28f592496 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:51.610040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd71bb1-c68e-4787-b083-5fc28f592496 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:51.610338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd71bb1-c68e-4787-b083-5fc28f592496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:51.619785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd71bb1-c68e-4787-b083-5fc28f592496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:51.621397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd71bb1-c68e-4787-b083-5fc28f592496 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:51.632032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1228/2452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:15:55.527485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed76cc9-5b84-4710-9dac-3139e2ec114a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:55.527952 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed76cc9-5b84-4710-9dac-3139e2ec114a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:55.528071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed76cc9-5b84-4710-9dac-3139e2ec114a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:55.548923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-eed76cc9-5b84-4710-9dac-3139e2ec114a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:55.550147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-eed76cc9-5b84-4710-9dac-3139e2ec114a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:55.558600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1225/2453] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:55.583111 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd71bb1-c68e-4787-b083-5fc28f592496 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:55.596084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd71bb1-c68e-4787-b083-5fc28f592496 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:55.601822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e3741-955e-4a3e-aa84-87c0d2f2e413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:55.602474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e3741-955e-4a3e-aa84-87c0d2f2e413 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:55.602764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e3741-955e-4a3e-aa84-87c0d2f2e413 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:55.603048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e3741-955e-4a3e-aa84-87c0d2f2e413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:55.612721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e3741-955e-4a3e-aa84-87c0d2f2e413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:55.614297 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e3741-955e-4a3e-aa84-87c0d2f2e413 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:55.625433 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1229/2454] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:15:59.600900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840e8d5-4e69-48fd-afd1-1a3d7b233f0a None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:59.601432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840e8d5-4e69-48fd-afd1-1a3d7b233f0a None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:59.601550 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840e8d5-4e69-48fd-afd1-1a3d7b233f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:59.742609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-a840e8d5-4e69-48fd-afd1-1a3d7b233f0a None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:15:59.743835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a840e8d5-4e69-48fd-afd1-1a3d7b233f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:59.751783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1226/2455] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:15:59.780362 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e3741-955e-4a3e-aa84-87c0d2f2e413 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:15:59.781842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-067e3741-955e-4a3e-aa84-87c0d2f2e413 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:15:59.796732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e3741-955e-4a3e-aa84-87c0d2f2e413 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:15:59.802129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84191ff6-9ab9-402d-8aae-f2da57ba71b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:15:59.802769 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191ff6-9ab9-402d-8aae-f2da57ba71b8 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:15:59.803055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191ff6-9ab9-402d-8aae-f2da57ba71b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:15:59.803334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191ff6-9ab9-402d-8aae-f2da57ba71b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:15:59.811434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84191ff6-9ab9-402d-8aae-f2da57ba71b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:15:59.813021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84191ff6-9ab9-402d-8aae-f2da57ba71b8 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:15:59.822315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1230/2456] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:16:03.787455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b3fb-b3d9-4efb-9cee-832174233418 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:03.788072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b3fb-b3d9-4efb-9cee-832174233418 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:03.788072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b3fb-b3d9-4efb-9cee-832174233418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:03.805524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4977b3fb-b3d9-4efb-9cee-832174233418 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:03.806779 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4977b3fb-b3d9-4efb-9cee-832174233418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:03.814719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1227/2457] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:03.853959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84191ff6-9ab9-402d-8aae-f2da57ba71b8 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:03.865217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84191ff6-9ab9-402d-8aae-f2da57ba71b8 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:03.870922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e84b6-267e-4e33-9744-90413ae361aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:03.871588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e84b6-267e-4e33-9744-90413ae361aa service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:03.871878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e84b6-267e-4e33-9744-90413ae361aa service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:03.872184 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e84b6-267e-4e33-9744-90413ae361aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:03.881090 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e84b6-267e-4e33-9744-90413ae361aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:03.882634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e84b6-267e-4e33-9744-90413ae361aa service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:03.893026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1231/2458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:16:08.761950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e95b7-7cb8-4fcb-a832-45df505ccf84 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:08.762485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e95b7-7cb8-4fcb-a832-45df505ccf84 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:08.762485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e95b7-7cb8-4fcb-a832-45df505ccf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:08.780180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-d54e95b7-7cb8-4fcb-a832-45df505ccf84 None None] MFA Rules not processed for user `966f641526b64cf3aec1744a141a2f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:08.781432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d54e95b7-7cb8-4fcb-a832-45df505ccf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:08.834746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1228/2459] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:16:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:08.981993 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84883f82-00b1-4ec4-accd-f86cb514a1f3 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:08.982565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84883f82-00b1-4ec4-accd-f86cb514a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:08.982565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84883f82-00b1-4ec4-accd-f86cb514a1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:09.001817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-84883f82-00b1-4ec4-accd-f86cb514a1f3 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:09.003130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-84883f82-00b1-4ec4-accd-f86cb514a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:09.011079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1232/2460] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 13 22:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:09.040431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e95b7-7cb8-4fcb-a832-45df505ccf84 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:09.055856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e95b7-7cb8-4fcb-a832-45df505ccf84 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:09.062625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec656720-14dc-42c0-a331-2c08c72cce89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:09.063410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec656720-14dc-42c0-a331-2c08c72cce89 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:09.063589 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec656720-14dc-42c0-a331-2c08c72cce89 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:09.063857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec656720-14dc-42c0-a331-2c08c72cce89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:09.072452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec656720-14dc-42c0-a331-2c08c72cce89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:09.074027 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec656720-14dc-42c0-a331-2c08c72cce89 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:09.085532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1229/2461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:16:18.996978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:19.080988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:28.777798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9fccf-159f-41ce-b887-d553626bda4c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:28.779294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9fccf-159f-41ce-b887-d553626bda4c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:28.779402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9fccf-159f-41ce-b887-d553626bda4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:28.798711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-9be9fccf-159f-41ce-b887-d553626bda4c None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:28.799927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9be9fccf-159f-41ce-b887-d553626bda4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:28.864158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1233/2462] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:28.878768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec656720-14dc-42c0-a331-2c08c72cce89 service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:28.882959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec656720-14dc-42c0-a331-2c08c72cce89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:28.956601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec656720-14dc-42c0-a331-2c08c72cce89 service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:28.961636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a90fe8-ca96-4238-9898-5bb03b5cb51f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:28.962286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a90fe8-ca96-4238-9898-5bb03b5cb51f service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:28.962575 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a90fe8-ca96-4238-9898-5bb03b5cb51f service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:28.962859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a90fe8-ca96-4238-9898-5bb03b5cb51f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:28.972121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a90fe8-ca96-4238-9898-5bb03b5cb51f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:28.973702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a90fe8-ca96-4238-9898-5bb03b5cb51f service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:28.982023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1230/2463] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:16:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:16:37.331728 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9fccf-159f-41ce-b887-d553626bda4c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:37.333626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9be9fccf-159f-41ce-b887-d553626bda4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:37.361301 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9fccf-159f-41ce-b887-d553626bda4c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:37.378454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:37.379564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:37.380064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:37.380493 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] PATH_INFO: `/v3/users/c71e317587f6475790af1cc766215358` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:37.382121 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71e317587f6475790af1cc766215358)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:37.384099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:37.491051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71e317587f6475790af1cc766215358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:37.513323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71e317587f6475790af1cc766215358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:37.515019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71e317587f6475790af1cc766215358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:37.536686 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71e317587f6475790af1cc766215358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:37.537779 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71e317587f6475790af1cc766215358'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:37.553402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1234/2464] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:16:37 2022] DELETE /identity/v3/users/c71e317587f6475790af1cc766215358 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:16:37.813401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a90fe8-ca96-4238-9898-5bb03b5cb51f service swift] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:37.834859 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a90fe8-ca96-4238-9898-5bb03b5cb51f service swift] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:37.934206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:37.936748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:37.937264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:37.937574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] PATH_INFO: `/v3/projects/14805311b4114b789a1d518f9dc4c491` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:37.939492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=14805311b4114b789a1d518f9dc4c491)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:37.941840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:38.003399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14805311b4114b789a1d518f9dc4c491', 'request_id': 'req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.011551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14805311b4114b789a1d518f9dc4c491', 'request_id': 'req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.025661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14805311b4114b789a1d518f9dc4c491', 'request_id': 'req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.046209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] The token cache is being invalidate because project 14805311b4114b789a1d518f9dc4c491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:16:38.049058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.050437 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.055713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1231/2465] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:16:37 2022] DELETE /identity/v3/projects/14805311b4114b789a1d518f9dc4c491 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:16:38.058336 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:38.061097 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:38.084598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc620-ec2c-4a52-ba14-9b4058cefb72 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:38.153346 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:38.154926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:38.155278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:38.155562 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] PATH_INFO: `/v3/users/d225039cc76345388cabe3b8d05529cc` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:38.156838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d225039cc76345388cabe3b8d05529cc)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:38.158773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:38.181782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:38.222749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd225039cc76345388cabe3b8d05529cc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.231494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd225039cc76345388cabe3b8d05529cc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.232310 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd225039cc76345388cabe3b8d05529cc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.258577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd225039cc76345388cabe3b8d05529cc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.259753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-32ea2421-9eff-471f-9474-386150796108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd225039cc76345388cabe3b8d05529cc'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.277094 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1235/2466] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:16:38 2022] DELETE /identity/v3/users/d225039cc76345388cabe3b8d05529cc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:16:38.481950 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:38.483579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:38.498560 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0d4e-a1cc-444a-bdf6-518e3cb2b10e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:38.527200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:38.573995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:38.574963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:38.575323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:38.575674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] PATH_INFO: `/v3/projects/da24e434e27a42b4a0a1f35310747d1b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:38.577748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=da24e434e27a42b4a0a1f35310747d1b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:38.579671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:38.635502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da24e434e27a42b4a0a1f35310747d1b', 'request_id': 'req-c97f50db-04fa-4f76-9224-b9b184b7b5ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.643219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da24e434e27a42b4a0a1f35310747d1b', 'request_id': 'req-c97f50db-04fa-4f76-9224-b9b184b7b5ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.651623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da24e434e27a42b4a0a1f35310747d1b', 'request_id': 'req-c97f50db-04fa-4f76-9224-b9b184b7b5ed'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.663157 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] The token cache is being invalidate because project da24e434e27a42b4a0a1f35310747d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:16:38.663451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.664183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c97f50db-04fa-4f76-9224-b9b184b7b5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:38.666188 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1232/2467] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:16:38 2022] DELETE /identity/v3/projects/da24e434e27a42b4a0a1f35310747d1b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:16:39.687866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fbb54-05d2-44d3-aa38-eb6024fadfc8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:39.688416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fbb54-05d2-44d3-aa38-eb6024fadfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:39.688516 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fbb54-05d2-44d3-aa38-eb6024fadfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:39.706420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ff2fbb54-05d2-44d3-aa38-eb6024fadfc8 None None] MFA Rules not processed for user `e5a2ca1c3b1b43cd9c9fe090d2d41cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:39.707631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ff2fbb54-05d2-44d3-aa38-eb6024fadfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:39.768017 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1236/2468] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:16:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:40.825743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e2fcb-5149-40ef-ac29-3b942028ff43 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:40.826989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e2fcb-5149-40ef-ac29-3b942028ff43 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:40.826989 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e2fcb-5149-40ef-ac29-3b942028ff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:40.844985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ee7e2fcb-5149-40ef-ac29-3b942028ff43 None None] MFA Rules not processed for user `71516217b1714e84bda9e584c97e84b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:40.846196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ee7e2fcb-5149-40ef-ac29-3b942028ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:40.912172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1233/2469] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:43.210077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fbb54-05d2-44d3-aa38-eb6024fadfc8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:43.212155 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ff2fbb54-05d2-44d3-aa38-eb6024fadfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:43.286908 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fbb54-05d2-44d3-aa38-eb6024fadfc8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:43.292294 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:43.293183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:43.293470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:43.293742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] PATH_INFO: `/v3/users/6d7eae84d1ac486abd9c59c5adc3b5f8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:43.298082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7eae84d1ac486abd9c59c5adc3b5f8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:43.300308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:43.347757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:43.351534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7eae84d1ac486abd9c59c5adc3b5f8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.362918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7eae84d1ac486abd9c59c5adc3b5f8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.365015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7eae84d1ac486abd9c59c5adc3b5f8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.381200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7eae84d1ac486abd9c59c5adc3b5f8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.381931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-29da3397-8575-4dea-a037-a1a37af0f2a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7eae84d1ac486abd9c59c5adc3b5f8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.395138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1237/2470] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:16:43 2022] DELETE /identity/v3/users/6d7eae84d1ac486abd9c59c5adc3b5f8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:16:43.622774 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e2fcb-5149-40ef-ac29-3b942028ff43 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:43.634263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e2fcb-5149-40ef-ac29-3b942028ff43 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:43.698237 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:43.709201 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:43.710235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:43.710673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:43.711121 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] PATH_INFO: `/v3/projects/137084eff67149c8a62b615ff9f7a4ea` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:43.712515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137084eff67149c8a62b615ff9f7a4ea)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:43.714518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:43.763879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137084eff67149c8a62b615ff9f7a4ea', 'request_id': 'req-62d108bc-8462-4848-bbcc-00dd6fde37b5'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.770213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137084eff67149c8a62b615ff9f7a4ea', 'request_id': 'req-62d108bc-8462-4848-bbcc-00dd6fde37b5'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.777478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137084eff67149c8a62b615ff9f7a4ea', 'request_id': 'req-62d108bc-8462-4848-bbcc-00dd6fde37b5'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.804252 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] The token cache is being invalidate because project 137084eff67149c8a62b615ff9f7a4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:16:43.804547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.805356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-62d108bc-8462-4848-bbcc-00dd6fde37b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:43.806874 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1234/2471] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:16:43 2022] DELETE /identity/v3/projects/137084eff67149c8a62b615ff9f7a4ea => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:16:43.812168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e55138-5132-48e4-ae6b-6a6e6beb7e61 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:43.812466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e55138-5132-48e4-ae6b-6a6e6beb7e61 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:43.812750 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e55138-5132-48e4-ae6b-6a6e6beb7e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:43.832127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-84e55138-5132-48e4-ae6b-6a6e6beb7e61 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:43.833390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-84e55138-5132-48e4-ae6b-6a6e6beb7e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:43.906903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1238/2472] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:43.909138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da92f7-5719-48bc-ad28-aece8416c6a7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:43.909718 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da92f7-5719-48bc-ad28-aece8416c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:43.910210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da92f7-5719-48bc-ad28-aece8416c6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:43.934158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-18da92f7-5719-48bc-ad28-aece8416c6a7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:43.936230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-18da92f7-5719-48bc-ad28-aece8416c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:43.948133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1235/2473] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:43.949343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e55138-5132-48e4-ae6b-6a6e6beb7e61 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:43.959533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e55138-5132-48e4-ae6b-6a6e6beb7e61 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:43.976227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e705f-972b-4a20-9f36-01ecd6b3f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:43.977044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e705f-972b-4a20-9f36-01ecd6b3f5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:43.977177 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e705f-972b-4a20-9f36-01ecd6b3f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:43.977560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e705f-972b-4a20-9f36-01ecd6b3f5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:43.978475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e705f-972b-4a20-9f36-01ecd6b3f5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:16:43.978956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e705f-972b-4a20-9f36-01ecd6b3f5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:43.981472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e705f-972b-4a20-9f36-01ecd6b3f5e4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:44.001168 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1239/2474] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:16:44.002684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da92f7-5719-48bc-ad28-aece8416c6a7 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:44.016251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da92f7-5719-48bc-ad28-aece8416c6a7 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:44.021717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc44b56-cc91-48bb-92f8-a0adcc3763e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:44.022386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc44b56-cc91-48bb-92f8-a0adcc3763e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:44.022783 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc44b56-cc91-48bb-92f8-a0adcc3763e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:44.023060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc44b56-cc91-48bb-92f8-a0adcc3763e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:44.023925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc44b56-cc91-48bb-92f8-a0adcc3763e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:44.025893 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc44b56-cc91-48bb-92f8-a0adcc3763e1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:44.059033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1236/2475] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:16:44 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:16:44.064178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e705f-972b-4a20-9f36-01ecd6b3f5e4 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:44.074813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e705f-972b-4a20-9f36-01ecd6b3f5e4 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:44.158872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409ac50-8464-4938-b282-1e2b0199dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:44.159697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409ac50-8464-4938-b282-1e2b0199dbad admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:44.160112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409ac50-8464-4938-b282-1e2b0199dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:44.160454 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409ac50-8464-4938-b282-1e2b0199dbad admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:44.161213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409ac50-8464-4938-b282-1e2b0199dbad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:44.163170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409ac50-8464-4938-b282-1e2b0199dbad admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:44.188130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1240/2476] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:16:44 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:16:44.189335 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc44b56-cc91-48bb-92f8-a0adcc3763e1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:44.199857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc44b56-cc91-48bb-92f8-a0adcc3763e1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:44.205508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbb52e-5294-472f-9904-2ce1915f4b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:44.206238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbb52e-5294-472f-9904-2ce1915f4b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:44.206616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbb52e-5294-472f-9904-2ce1915f4b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:44.206977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbb52e-5294-472f-9904-2ce1915f4b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:44.207831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbb52e-5294-472f-9904-2ce1915f4b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:44.209512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbb52e-5294-472f-9904-2ce1915f4b00 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:44.223840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1237/2477] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:16:44.225688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409ac50-8464-4938-b282-1e2b0199dbad admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:44.237318 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409ac50-8464-4938-b282-1e2b0199dbad admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:44.242620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f296ae8-2ccd-4611-95e3-632f10e43d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:44.243474 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f296ae8-2ccd-4611-95e3-632f10e43d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:44.243829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f296ae8-2ccd-4611-95e3-632f10e43d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:44.244075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f296ae8-2ccd-4611-95e3-632f10e43d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:44.244817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f296ae8-2ccd-4611-95e3-632f10e43d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:44.246489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f296ae8-2ccd-4611-95e3-632f10e43d25 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:44.261573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1241/2478] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:16:44.266732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbb52e-5294-472f-9904-2ce1915f4b00 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:44.284937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbb52e-5294-472f-9904-2ce1915f4b00 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:44.289750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec3fb-5c85-4df3-8dc4-e7e235c5cf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:44.290640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec3fb-5c85-4df3-8dc4-e7e235c5cf04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:44.290917 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec3fb-5c85-4df3-8dc4-e7e235c5cf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:44.291188 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec3fb-5c85-4df3-8dc4-e7e235c5cf04 admin admin] PATH_INFO: `/v3/projects/9756b7b1c7304d7fb4869cdd24053c18/users/a09bcc2a030b430399cec25acf6e1685/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:44.314452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ec3fb-5c85-4df3-8dc4-e7e235c5cf04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9756b7b1c7304d7fb4869cdd24053c18, user_id=a09bcc2a030b430399cec25acf6e1685, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:44.317793 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ec3fb-5c85-4df3-8dc4-e7e235c5cf04 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:44.336238 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1238/2479] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:16:44 2022] PUT /identity/v3/projects/9756b7b1c7304d7fb4869cdd24053c18/users/a09bcc2a030b430399cec25acf6e1685/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:16:44.347618 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98534-08ad-46f6-a6f9-345d6ab60fa7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:44.347941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98534-08ad-46f6-a6f9-345d6ab60fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:44.348233 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98534-08ad-46f6-a6f9-345d6ab60fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:44.379476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-29b98534-08ad-46f6-a6f9-345d6ab60fa7 None None] MFA Rules not processed for user `a09bcc2a030b430399cec25acf6e1685`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:44.380973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-29b98534-08ad-46f6-a6f9-345d6ab60fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:44.400852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:44.463572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1242/2480] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:16:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:44.475402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec3fb-5c85-4df3-8dc4-e7e235c5cf04 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:44.477161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-420ec3fb-5c85-4df3-8dc4-e7e235c5cf04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:44.536819 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec3fb-5c85-4df3-8dc4-e7e235c5cf04 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:44.540563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb7e9c-915c-4d51-be83-ba89999e02b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:44.541216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb7e9c-915c-4d51-be83-ba89999e02b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:44.541500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb7e9c-915c-4d51-be83-ba89999e02b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:44.541764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb7e9c-915c-4d51-be83-ba89999e02b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:44.550629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb7e9c-915c-4d51-be83-ba89999e02b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:44.552462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb7e9c-915c-4d51-be83-ba89999e02b5 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:44.561857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1239/2481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:16:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:16:54.460877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=20 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:54.557937 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:54.696979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b98534-08ad-46f6-a6f9-345d6ab60fa7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:54.763270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b98534-08ad-46f6-a6f9-345d6ab60fa7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:54.767951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:54.768842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:54.769125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:54.769403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] PATH_INFO: `/v3/users/a09bcc2a030b430399cec25acf6e1685` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:54.770609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09bcc2a030b430399cec25acf6e1685)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:54.772597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:54.834056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09bcc2a030b430399cec25acf6e1685'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:54.842117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09bcc2a030b430399cec25acf6e1685'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:54.842788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09bcc2a030b430399cec25acf6e1685'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:54.856155 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09bcc2a030b430399cec25acf6e1685'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:54.858790 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09bcc2a030b430399cec25acf6e1685'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:54.870113 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1243/2482] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:16:54 2022] DELETE /identity/v3/users/a09bcc2a030b430399cec25acf6e1685 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:16:54.874849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587c892-ff17-43d0-b1ef-9ea82096e7ab None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:54.875141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587c892-ff17-43d0-b1ef-9ea82096e7ab None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:54.875415 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587c892-ff17-43d0-b1ef-9ea82096e7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:54.893532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9587c892-ff17-43d0-b1ef-9ea82096e7ab None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:16:54.894746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9587c892-ff17-43d0-b1ef-9ea82096e7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:54.957052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1240/2483] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:16:54.967011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:54.968736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:55.027052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99e972-e7f9-4e49-bac0-5e7f3315eef7 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:55.030915 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58196d-db08-41b9-ad1e-e843d8b17947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:55.031571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58196d-db08-41b9-ad1e-e843d8b17947 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:55.031859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58196d-db08-41b9-ad1e-e843d8b17947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:55.032174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58196d-db08-41b9-ad1e-e843d8b17947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:55.041803 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58196d-db08-41b9-ad1e-e843d8b17947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:55.043255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58196d-db08-41b9-ad1e-e843d8b17947 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:55.054322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1244/2484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:16:55.337390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587c892-ff17-43d0-b1ef-9ea82096e7ab None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:55.342842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9587c892-ff17-43d0-b1ef-9ea82096e7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:55.352322 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587c892-ff17-43d0-b1ef-9ea82096e7ab None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:55.359932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:55.360909 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:55.361273 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:55.361623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] PATH_INFO: `/v3/projects/9756b7b1c7304d7fb4869cdd24053c18` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:55.362924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9756b7b1c7304d7fb4869cdd24053c18)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:55.366283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:55.415601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9756b7b1c7304d7fb4869cdd24053c18', 'request_id': 'req-3eb5be0c-0d78-40c4-826a-711d8acb06e6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:55.421976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9756b7b1c7304d7fb4869cdd24053c18', 'request_id': 'req-3eb5be0c-0d78-40c4-826a-711d8acb06e6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:55.429223 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9756b7b1c7304d7fb4869cdd24053c18', 'request_id': 'req-3eb5be0c-0d78-40c4-826a-711d8acb06e6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:55.440448 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] The token cache is being invalidate because project 9756b7b1c7304d7fb4869cdd24053c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:16:55.440738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:55.441365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:16:55.443011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1241/2485] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:16:55 2022] DELETE /identity/v3/projects/9756b7b1c7304d7fb4869cdd24053c18 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:16:57.205558 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58196d-db08-41b9-ad1e-e843d8b17947 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:16:57.206960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ad58196d-db08-41b9-ad1e-e843d8b17947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:57.232492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:16:57.264077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58196d-db08-41b9-ad1e-e843d8b17947 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:16:57.312141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:16:57.312785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:16:57.313067 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:16:57.313341 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:16:57.315100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:16:57.382660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:16:57.384030 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:16:57.395677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1245/2486] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:16:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:00.051553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:00.053198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:00.120647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5be0c-0d78-40c4-826a-711d8acb06e6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:00.124933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8cbcb-29b6-4185-9660-ce2630401f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:00.125679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8cbcb-29b6-4185-9660-ce2630401f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:00.126156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8cbcb-29b6-4185-9660-ce2630401f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:00.126633 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8cbcb-29b6-4185-9660-ce2630401f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:00.129466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-94e8cbcb-29b6-4185-9660-ce2630401f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:00.147699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8cbcb-29b6-4185-9660-ce2630401f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:00.150091 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8cbcb-29b6-4185-9660-ce2630401f2a service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:00.162412 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1242/2487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:07.390695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=64 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:10.157107 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:12.547360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:12.548808 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:12.562320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d2cc6-1149-4bb0-ba50-283d441ead34 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:12.567763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:12.568430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:12.568715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:12.569019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:12.570725 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:12.628130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:12.629690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:12.639620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1246/2488] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:17.342961 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8cbcb-29b6-4185-9660-ce2630401f2a service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:17.351623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8cbcb-29b6-4185-9660-ce2630401f2a service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:17.355251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:17.356584 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:17.357109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:17.357515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:17.359286 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:17.422576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:17.424002 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:17.433665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1243/2489] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:20.273749 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:20.275484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:20.336822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:20.337960 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:20.356650 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a786-f370-4d44-b2b6-0e71c47e5ad9 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:20.361924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:20.362814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:20.363248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:20.363532 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] PATH_INFO: `/v3/users/966f641526b64cf3aec1744a141a2f56` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:20.364812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966f641526b64cf3aec1744a141a2f56)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:20.365730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eff4e9-eb7f-4550-a50e-22e30c4afbf6 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:20.366934 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:20.372256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293f4fb-fb9a-49e6-b924-c209cb12b278 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:20.372917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f4fb-fb9a-49e6-b924-c209cb12b278 service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:20.373432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f4fb-fb9a-49e6-b924-c209cb12b278 service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:20.373535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f4fb-fb9a-49e6-b924-c209cb12b278 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:20.375328 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1293f4fb-fb9a-49e6-b924-c209cb12b278 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:20.390003 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293f4fb-fb9a-49e6-b924-c209cb12b278 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:20.391681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293f4fb-fb9a-49e6-b924-c209cb12b278 service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:20.402322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1247/2490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:20.431981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966f641526b64cf3aec1744a141a2f56'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.445795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966f641526b64cf3aec1744a141a2f56'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.460003 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966f641526b64cf3aec1744a141a2f56'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.460861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966f641526b64cf3aec1744a141a2f56'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.461478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3311956-cb8e-4ba7-9c5f-defa64afa3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966f641526b64cf3aec1744a141a2f56'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.474801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1244/2491] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:20 2022] DELETE /identity/v3/users/966f641526b64cf3aec1744a141a2f56 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:17:20.660248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293f4fb-fb9a-49e6-b924-c209cb12b278 service placement] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:20.673056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293f4fb-fb9a-49e6-b924-c209cb12b278 service placement] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:20.730495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:20.732577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:20.732869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:20.733154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] PATH_INFO: `/v3/projects/7a1e9ade3fe842d4993558cc3d255ada` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:20.734411 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1e9ade3fe842d4993558cc3d255ada)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:20.736380 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:20.770148 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:20.783576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1e9ade3fe842d4993558cc3d255ada', 'request_id': 'req-be911aee-a543-4f7d-889c-0a9996a24440'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.789831 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1e9ade3fe842d4993558cc3d255ada', 'request_id': 'req-be911aee-a543-4f7d-889c-0a9996a24440'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.796138 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1e9ade3fe842d4993558cc3d255ada', 'request_id': 'req-be911aee-a543-4f7d-889c-0a9996a24440'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.807762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] The token cache is being invalidate because project 7a1e9ade3fe842d4993558cc3d255ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:20.808087 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.808754 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-be911aee-a543-4f7d-889c-0a9996a24440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:20.811217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1248/2492] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:20 2022] DELETE /identity/v3/projects/7a1e9ade3fe842d4993558cc3d255ada => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:20.816295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84363968-8037-4b82-b33a-29f09d08baf4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:20.816585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84363968-8037-4b82-b33a-29f09d08baf4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:20.816863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84363968-8037-4b82-b33a-29f09d08baf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:20.836072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-84363968-8037-4b82-b33a-29f09d08baf4 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:20.837623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-84363968-8037-4b82-b33a-29f09d08baf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:20.898726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1245/2493] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:17:20.907333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af06e7d-0965-4d3c-b4ba-ea08d7939e95 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:20.907669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af06e7d-0965-4d3c-b4ba-ea08d7939e95 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:20.907976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af06e7d-0965-4d3c-b4ba-ea08d7939e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:20.926383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5af06e7d-0965-4d3c-b4ba-ea08d7939e95 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:20.927582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5af06e7d-0965-4d3c-b4ba-ea08d7939e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:20.936065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1249/2494] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:20.940159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84363968-8037-4b82-b33a-29f09d08baf4 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:20.950029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84363968-8037-4b82-b33a-29f09d08baf4 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:20.955623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cac212-7410-46f7-9c8d-7cdfe3973c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:20.956682 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cac212-7410-46f7-9c8d-7cdfe3973c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:20.956991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cac212-7410-46f7-9c8d-7cdfe3973c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:20.957262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cac212-7410-46f7-9c8d-7cdfe3973c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:20.957982 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cac212-7410-46f7-9c8d-7cdfe3973c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:17:20.958288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cac212-7410-46f7-9c8d-7cdfe3973c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:20.959871 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cac212-7410-46f7-9c8d-7cdfe3973c6f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:20.961490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:20.974579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1246/2495] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:17:20.978978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af06e7d-0965-4d3c-b4ba-ea08d7939e95 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:20.988846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af06e7d-0965-4d3c-b4ba-ea08d7939e95 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:20.993465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185172-e4cc-4658-88f8-1baf42d37673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:20.994114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185172-e4cc-4658-88f8-1baf42d37673 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:20.994402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185172-e4cc-4658-88f8-1baf42d37673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:20.994682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185172-e4cc-4658-88f8-1baf42d37673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:20.995366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d185172-e4cc-4658-88f8-1baf42d37673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:20.997511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d185172-e4cc-4658-88f8-1baf42d37673 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.022315 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1250/2496] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:20 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:21.026538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cac212-7410-46f7-9c8d-7cdfe3973c6f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.037983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cac212-7410-46f7-9c8d-7cdfe3973c6f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.102104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fc567-a057-4150-ba6f-3ceaed675c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.102772 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fc567-a057-4150-ba6f-3ceaed675c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.103063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fc567-a057-4150-ba6f-3ceaed675c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.103346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fc567-a057-4150-ba6f-3ceaed675c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.104079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fc567-a057-4150-ba6f-3ceaed675c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.107165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fc567-a057-4150-ba6f-3ceaed675c49 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.130484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1247/2497] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:21 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:21.135158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185172-e4cc-4658-88f8-1baf42d37673 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.145499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185172-e4cc-4658-88f8-1baf42d37673 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.150145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bacc6-93ca-475a-beb3-4e259c437196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.150810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bacc6-93ca-475a-beb3-4e259c437196 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.151098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bacc6-93ca-475a-beb3-4e259c437196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.151390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bacc6-93ca-475a-beb3-4e259c437196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.152152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bacc6-93ca-475a-beb3-4e259c437196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.154255 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bacc6-93ca-475a-beb3-4e259c437196 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.164588 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1251/2498] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:21.169376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fc567-a057-4150-ba6f-3ceaed675c49 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.179321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fc567-a057-4150-ba6f-3ceaed675c49 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.184090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253f91-4c19-4a7a-8c92-b265092c0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.184739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253f91-4c19-4a7a-8c92-b265092c0c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.185029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253f91-4c19-4a7a-8c92-b265092c0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.185310 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253f91-4c19-4a7a-8c92-b265092c0c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.186032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253f91-4c19-4a7a-8c92-b265092c0c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.187636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253f91-4c19-4a7a-8c92-b265092c0c51 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.197467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1248/2499] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:21.201585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bacc6-93ca-475a-beb3-4e259c437196 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.211262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bacc6-93ca-475a-beb3-4e259c437196 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.216507 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e509d-0da5-44f4-b090-8c92abaade1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.217430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e509d-0da5-44f4-b090-8c92abaade1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.217712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e509d-0da5-44f4-b090-8c92abaade1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.217994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e509d-0da5-44f4-b090-8c92abaade1b admin admin] PATH_INFO: `/v3/projects/6e9d7f7ca24b43cab426935ae627d57f/users/16629afb84874e6a98e81e3540a38f09/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.232727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e509d-0da5-44f4-b090-8c92abaade1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9d7f7ca24b43cab426935ae627d57f, user_id=16629afb84874e6a98e81e3540a38f09, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.235334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e509d-0da5-44f4-b090-8c92abaade1b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.247638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1252/2500] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:21 2022] PUT /identity/v3/projects/6e9d7f7ca24b43cab426935ae627d57f/users/16629afb84874e6a98e81e3540a38f09/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:21.258357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c931-2000-4e8e-8e66-c326a2b9c576 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.258674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c931-2000-4e8e-8e66-c326a2b9c576 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.258976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c931-2000-4e8e-8e66-c326a2b9c576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.285436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-eae4c931-2000-4e8e-8e66-c326a2b9c576 None None] MFA Rules not processed for user `16629afb84874e6a98e81e3540a38f09`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:21.286643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-eae4c931-2000-4e8e-8e66-c326a2b9c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:21.349524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1249/2501] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:21.354033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e509d-0da5-44f4-b090-8c92abaade1b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.415410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e509d-0da5-44f4-b090-8c92abaade1b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.420186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68706f23-0c34-49f4-8c8a-62b917e74bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.420838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68706f23-0c34-49f4-8c8a-62b917e74bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.421124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68706f23-0c34-49f4-8c8a-62b917e74bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.421403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68706f23-0c34-49f4-8c8a-62b917e74bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.422084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68706f23-0c34-49f4-8c8a-62b917e74bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.423982 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68706f23-0c34-49f4-8c8a-62b917e74bd8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.448056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1253/2502] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:21 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:21.453173 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c931-2000-4e8e-8e66-c326a2b9c576 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.463795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c931-2000-4e8e-8e66-c326a2b9c576 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.524752 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052cfaf-e97a-4d0c-8886-a1f4331d856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.525423 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052cfaf-e97a-4d0c-8886-a1f4331d856a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.525709 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052cfaf-e97a-4d0c-8886-a1f4331d856a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.525988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052cfaf-e97a-4d0c-8886-a1f4331d856a admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.526670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052cfaf-e97a-4d0c-8886-a1f4331d856a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.529511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052cfaf-e97a-4d0c-8886-a1f4331d856a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.536864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:21.549475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1250/2503] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:21 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:21.553571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68706f23-0c34-49f4-8c8a-62b917e74bd8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.564573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68706f23-0c34-49f4-8c8a-62b917e74bd8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.569480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a6696-4198-45dc-9a7e-c89d99d1d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.570187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6696-4198-45dc-9a7e-c89d99d1d48a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.570432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6696-4198-45dc-9a7e-c89d99d1d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.570707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6696-4198-45dc-9a7e-c89d99d1d48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.571435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a6696-4198-45dc-9a7e-c89d99d1d48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.573122 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a6696-4198-45dc-9a7e-c89d99d1d48a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.584444 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1254/2504] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:21.588612 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052cfaf-e97a-4d0c-8886-a1f4331d856a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.598518 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052cfaf-e97a-4d0c-8886-a1f4331d856a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.603171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fba9a-5f14-4c52-b73a-12e961a21c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.604088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fba9a-5f14-4c52-b73a-12e961a21c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.604377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fba9a-5f14-4c52-b73a-12e961a21c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.604653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fba9a-5f14-4c52-b73a-12e961a21c23 admin admin] PATH_INFO: `/v3/projects/55e910bca4a644618c58f982b2f0ddb3/users/f0d53a7e472142afb6fe9c1c5c1bcd15/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.619579 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fba9a-5f14-4c52-b73a-12e961a21c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e910bca4a644618c58f982b2f0ddb3, user_id=f0d53a7e472142afb6fe9c1c5c1bcd15, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.622895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fba9a-5f14-4c52-b73a-12e961a21c23 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.635418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1251/2505] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:21 2022] PUT /identity/v3/projects/55e910bca4a644618c58f982b2f0ddb3/users/f0d53a7e472142afb6fe9c1c5c1bcd15/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:21.639407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a6696-4198-45dc-9a7e-c89d99d1d48a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.649317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a6696-4198-45dc-9a7e-c89d99d1d48a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.675051 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:21.706861 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73212f1d-f63f-4106-ad68-a2db757a7cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.707517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73212f1d-f63f-4106-ad68-a2db757a7cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.707801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73212f1d-f63f-4106-ad68-a2db757a7cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.708133 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73212f1d-f63f-4106-ad68-a2db757a7cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.708852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73212f1d-f63f-4106-ad68-a2db757a7cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.710446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73212f1d-f63f-4106-ad68-a2db757a7cf4 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.720729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1255/2506] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:21.724801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fba9a-5f14-4c52-b73a-12e961a21c23 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.735147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fba9a-5f14-4c52-b73a-12e961a21c23 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.739734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda65af6-418f-406a-b85e-b18f9c35c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.740643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda65af6-418f-406a-b85e-b18f9c35c34a admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.740925 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda65af6-418f-406a-b85e-b18f9c35c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.741203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda65af6-418f-406a-b85e-b18f9c35c34a admin admin] PATH_INFO: `/v3/projects/55e910bca4a644618c58f982b2f0ddb3/users/f0d53a7e472142afb6fe9c1c5c1bcd15/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.743183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda65af6-418f-406a-b85e-b18f9c35c34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e910bca4a644618c58f982b2f0ddb3, user_id=f0d53a7e472142afb6fe9c1c5c1bcd15, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.745832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda65af6-418f-406a-b85e-b18f9c35c34a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.756935 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1252/2507] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:21 2022] PUT /identity/v3/projects/55e910bca4a644618c58f982b2f0ddb3/users/f0d53a7e472142afb6fe9c1c5c1bcd15/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:21.767499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d7de-d967-4e35-b8ba-b0a1dae28bc0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.767789 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d7de-d967-4e35-b8ba-b0a1dae28bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.768092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d7de-d967-4e35-b8ba-b0a1dae28bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.795027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-5c80d7de-d967-4e35-b8ba-b0a1dae28bc0 None None] MFA Rules not processed for user `f0d53a7e472142afb6fe9c1c5c1bcd15`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:21.796286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5c80d7de-d967-4e35-b8ba-b0a1dae28bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:21.863457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1256/2508] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:21.873958 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda65af6-418f-406a-b85e-b18f9c35c34a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:21.875726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bda65af6-418f-406a-b85e-b18f9c35c34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:21.938578 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda65af6-418f-406a-b85e-b18f9c35c34a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:21.942175 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6d6d6-de75-45ce-bc8a-8eff78e4d31b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:21.942812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6d6d6-de75-45ce-bc8a-8eff78e4d31b service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:21.943094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6d6d6-de75-45ce-bc8a-8eff78e4d31b service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:21.943369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6d6d6-de75-45ce-bc8a-8eff78e4d31b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:21.952374 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6d6d6-de75-45ce-bc8a-8eff78e4d31b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:21.953789 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6d6d6-de75-45ce-bc8a-8eff78e4d31b service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:21.962936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1253/2509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:23.255114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80d7de-d967-4e35-b8ba-b0a1dae28bc0 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:23.316909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80d7de-d967-4e35-b8ba-b0a1dae28bc0 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:23.321427 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:23.322288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:23.322571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:23.322849 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] PATH_INFO: `/v3/users/16629afb84874e6a98e81e3540a38f09` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:23.324055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16629afb84874e6a98e81e3540a38f09)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:23.327117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:23.371866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16629afb84874e6a98e81e3540a38f09'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.375519 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:23.379257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16629afb84874e6a98e81e3540a38f09'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.380342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16629afb84874e6a98e81e3540a38f09'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.393920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16629afb84874e6a98e81e3540a38f09'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.394599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16629afb84874e6a98e81e3540a38f09'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.406933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1257/2510] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:23 2022] DELETE /identity/v3/users/16629afb84874e6a98e81e3540a38f09 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:23.411510 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29aa88-236d-410a-9665-c12a41fcca7d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:23.412004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29aa88-236d-410a-9665-c12a41fcca7d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:23.412102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29aa88-236d-410a-9665-c12a41fcca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:23.429131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-3a29aa88-236d-410a-9665-c12a41fcca7d None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:23.430272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3a29aa88-236d-410a-9665-c12a41fcca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:23.487873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1254/2511] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:23.498236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:23.499619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:23.554845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8a3da-f945-44b2-b62a-ab6b0d603578 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:23.558436 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98471f3-918d-4981-aca9-33a20b9d7ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:23.559610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98471f3-918d-4981-aca9-33a20b9d7ecc service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:23.559888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98471f3-918d-4981-aca9-33a20b9d7ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:23.560191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98471f3-918d-4981-aca9-33a20b9d7ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:23.569005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98471f3-918d-4981-aca9-33a20b9d7ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:23.570478 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98471f3-918d-4981-aca9-33a20b9d7ecc service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:23.580545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1258/2512] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:23.846897 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29aa88-236d-410a-9665-c12a41fcca7d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:23.848373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3a29aa88-236d-410a-9665-c12a41fcca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:23.865385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29aa88-236d-410a-9665-c12a41fcca7d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:23.871852 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:23.872745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:23.873024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:23.873284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] PATH_INFO: `/v3/projects/6e9d7f7ca24b43cab426935ae627d57f` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:23.874472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9d7f7ca24b43cab426935ae627d57f)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:23.876528 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:23.922249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9d7f7ca24b43cab426935ae627d57f', 'request_id': 'req-f7f1d809-50d8-49ea-80c3-87f34c117bf9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.924100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:23.928719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9d7f7ca24b43cab426935ae627d57f', 'request_id': 'req-f7f1d809-50d8-49ea-80c3-87f34c117bf9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.936539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9d7f7ca24b43cab426935ae627d57f', 'request_id': 'req-f7f1d809-50d8-49ea-80c3-87f34c117bf9'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.947001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] The token cache is being invalidate because project 6e9d7f7ca24b43cab426935ae627d57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:23.947282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.947918 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:23.949462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1255/2513] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:23 2022] DELETE /identity/v3/projects/6e9d7f7ca24b43cab426935ae627d57f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:23.953772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98471f3-918d-4981-aca9-33a20b9d7ecc service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:23.963521 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98471f3-918d-4981-aca9-33a20b9d7ecc service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:24.021687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:24.022563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:24.022853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:24.023135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] PATH_INFO: `/v3/users/f0d53a7e472142afb6fe9c1c5c1bcd15` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:24.024366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d53a7e472142afb6fe9c1c5c1bcd15)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:24.026325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:24.070979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d53a7e472142afb6fe9c1c5c1bcd15'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.078477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d53a7e472142afb6fe9c1c5c1bcd15'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.079054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d53a7e472142afb6fe9c1c5c1bcd15'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.091180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d53a7e472142afb6fe9c1c5c1bcd15'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.091814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-30f381c4-017f-42fb-b215-fdb283f08546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d53a7e472142afb6fe9c1c5c1bcd15'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.093804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:24.105466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1259/2514] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:23 2022] DELETE /identity/v3/users/f0d53a7e472142afb6fe9c1c5c1bcd15 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:24.604666 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:24.606731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:24.619882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1d809-50d8-49ea-80c3-87f34c117bf9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:24.683413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:24.684913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:24.685200 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:24.685548 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] PATH_INFO: `/v3/projects/55e910bca4a644618c58f982b2f0ddb3` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:24.686795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e910bca4a644618c58f982b2f0ddb3)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:24.688775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:24.735009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e910bca4a644618c58f982b2f0ddb3', 'request_id': 'req-6d537db2-c534-4b78-81f7-385a0d50dadc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.740895 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e910bca4a644618c58f982b2f0ddb3', 'request_id': 'req-6d537db2-c534-4b78-81f7-385a0d50dadc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.748602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e910bca4a644618c58f982b2f0ddb3', 'request_id': 'req-6d537db2-c534-4b78-81f7-385a0d50dadc'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.758566 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] The token cache is being invalidate because project 55e910bca4a644618c58f982b2f0ddb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:24.758850 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.759458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-6d537db2-c534-4b78-81f7-385a0d50dadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:24.760985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1256/2515] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:24 2022] DELETE /identity/v3/projects/55e910bca4a644618c58f982b2f0ddb3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:24.766466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5aab7-e3df-4281-8062-162c036298c5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:24.766946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5aab7-e3df-4281-8062-162c036298c5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:24.767042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5aab7-e3df-4281-8062-162c036298c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:24.785835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7de5aab7-e3df-4281-8062-162c036298c5 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:24.786960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7de5aab7-e3df-4281-8062-162c036298c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:24.843668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1260/2516] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:24.850988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87c444-8c6e-45c8-9ca8-e57aef72a9d1 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:24.851276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87c444-8c6e-45c8-9ca8-e57aef72a9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:24.851556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87c444-8c6e-45c8-9ca8-e57aef72a9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:24.870369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ea87c444-8c6e-45c8-9ca8-e57aef72a9d1 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:24.871616 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ea87c444-8c6e-45c8-9ca8-e57aef72a9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:24.879607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1257/2517] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:24.885370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5aab7-e3df-4281-8062-162c036298c5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:24.895369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5aab7-e3df-4281-8062-162c036298c5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:24.900345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf721b87-f042-43b1-9e6c-7ec62ee041e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:24.901002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf721b87-f042-43b1-9e6c-7ec62ee041e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:24.901286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf721b87-f042-43b1-9e6c-7ec62ee041e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:24.901564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf721b87-f042-43b1-9e6c-7ec62ee041e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:24.902841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf721b87-f042-43b1-9e6c-7ec62ee041e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:17:24.903348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf721b87-f042-43b1-9e6c-7ec62ee041e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:24.904987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf721b87-f042-43b1-9e6c-7ec62ee041e8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:24.916663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1261/2518] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:17:24.921761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87c444-8c6e-45c8-9ca8-e57aef72a9d1 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:24.931024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87c444-8c6e-45c8-9ca8-e57aef72a9d1 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:24.935867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4fd27-4a17-46f3-80a6-2d178f449106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:24.936538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4fd27-4a17-46f3-80a6-2d178f449106 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:24.936822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4fd27-4a17-46f3-80a6-2d178f449106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:24.937097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4fd27-4a17-46f3-80a6-2d178f449106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:24.937787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4fd27-4a17-46f3-80a6-2d178f449106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:24.939663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4fd27-4a17-46f3-80a6-2d178f449106 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:24.964663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1258/2519] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:24 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:24.969278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf721b87-f042-43b1-9e6c-7ec62ee041e8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:24.979167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf721b87-f042-43b1-9e6c-7ec62ee041e8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.034791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a887560-8281-46a4-bf4a-b6c2178cb577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.035457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a887560-8281-46a4-bf4a-b6c2178cb577 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.035743 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a887560-8281-46a4-bf4a-b6c2178cb577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.036107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a887560-8281-46a4-bf4a-b6c2178cb577 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.036733 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a887560-8281-46a4-bf4a-b6c2178cb577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.038623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a887560-8281-46a4-bf4a-b6c2178cb577 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.058358 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1262/2520] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:24 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:25.062988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4fd27-4a17-46f3-80a6-2d178f449106 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.073466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4fd27-4a17-46f3-80a6-2d178f449106 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.084231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05419303-98f9-47d4-83a2-5ca36cb20cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.084904 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05419303-98f9-47d4-83a2-5ca36cb20cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.085189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05419303-98f9-47d4-83a2-5ca36cb20cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.085465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05419303-98f9-47d4-83a2-5ca36cb20cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.086206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05419303-98f9-47d4-83a2-5ca36cb20cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.087801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05419303-98f9-47d4-83a2-5ca36cb20cd1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.099541 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1259/2521] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:25.104032 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a887560-8281-46a4-bf4a-b6c2178cb577 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.116291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a887560-8281-46a4-bf4a-b6c2178cb577 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.120922 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bab11-58da-4270-94bc-fda42bba52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.122188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bab11-58da-4270-94bc-fda42bba52a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.122472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bab11-58da-4270-94bc-fda42bba52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.122751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bab11-58da-4270-94bc-fda42bba52a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.123480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bab11-58da-4270-94bc-fda42bba52a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.125105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bab11-58da-4270-94bc-fda42bba52a1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.135628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1263/2522] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:25.139769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05419303-98f9-47d4-83a2-5ca36cb20cd1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.149878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05419303-98f9-47d4-83a2-5ca36cb20cd1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.154553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90407fed-16f0-41d8-8a2f-58918b11c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.155454 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90407fed-16f0-41d8-8a2f-58918b11c884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.155738 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90407fed-16f0-41d8-8a2f-58918b11c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.156057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90407fed-16f0-41d8-8a2f-58918b11c884 admin admin] PATH_INFO: `/v3/projects/2079940be9bd4c5ea193126fa62cdc1f/users/cb9002353d604084aaab7e1faf5a2e0a/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.170599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90407fed-16f0-41d8-8a2f-58918b11c884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2079940be9bd4c5ea193126fa62cdc1f, user_id=cb9002353d604084aaab7e1faf5a2e0a, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.173262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90407fed-16f0-41d8-8a2f-58918b11c884 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.187097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1260/2523] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:25 2022] PUT /identity/v3/projects/2079940be9bd4c5ea193126fa62cdc1f/users/cb9002353d604084aaab7e1faf5a2e0a/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:25.197248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc100-52bb-40aa-a5af-5a017a2a732f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.197538 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc100-52bb-40aa-a5af-5a017a2a732f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.197814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc100-52bb-40aa-a5af-5a017a2a732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.224055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-ed9fc100-52bb-40aa-a5af-5a017a2a732f None None] MFA Rules not processed for user `cb9002353d604084aaab7e1faf5a2e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:25.225324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ed9fc100-52bb-40aa-a5af-5a017a2a732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:25.270548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:25.291061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1264/2524] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:25.296195 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90407fed-16f0-41d8-8a2f-58918b11c884 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.305057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:25.359380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90407fed-16f0-41d8-8a2f-58918b11c884 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.364000 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7916d4-1bbe-482a-a2d5-8e98a1c9f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.364654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7916d4-1bbe-482a-a2d5-8e98a1c9f24f admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.364940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7916d4-1bbe-482a-a2d5-8e98a1c9f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.365220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7916d4-1bbe-482a-a2d5-8e98a1c9f24f admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.365914 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7916d4-1bbe-482a-a2d5-8e98a1c9f24f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.367842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7916d4-1bbe-482a-a2d5-8e98a1c9f24f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.392603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1261/2525] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:25 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:25.396688 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc100-52bb-40aa-a5af-5a017a2a732f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.407755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc100-52bb-40aa-a5af-5a017a2a732f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.466166 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257534c-0007-40e7-ae94-2cea0da6c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.466852 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257534c-0007-40e7-ae94-2cea0da6c64c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.467142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257534c-0007-40e7-ae94-2cea0da6c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.467422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257534c-0007-40e7-ae94-2cea0da6c64c admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.468187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257534c-0007-40e7-ae94-2cea0da6c64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.471256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257534c-0007-40e7-ae94-2cea0da6c64c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.494846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1265/2526] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:25 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:17:25.499255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7916d4-1bbe-482a-a2d5-8e98a1c9f24f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.509399 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7916d4-1bbe-482a-a2d5-8e98a1c9f24f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.514465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb44b30-67f4-4d46-9bbe-aa8f909758e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.515113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44b30-67f4-4d46-9bbe-aa8f909758e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.515398 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44b30-67f4-4d46-9bbe-aa8f909758e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.515673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44b30-67f4-4d46-9bbe-aa8f909758e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.516426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb44b30-67f4-4d46-9bbe-aa8f909758e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.518011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb44b30-67f4-4d46-9bbe-aa8f909758e8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.528273 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1262/2527] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:25.532417 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257534c-0007-40e7-ae94-2cea0da6c64c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.543751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257534c-0007-40e7-ae94-2cea0da6c64c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.548600 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a66155-a0b1-40d5-9b16-e414a87fde53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.549672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a66155-a0b1-40d5-9b16-e414a87fde53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.549956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a66155-a0b1-40d5-9b16-e414a87fde53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.550236 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a66155-a0b1-40d5-9b16-e414a87fde53 admin admin] PATH_INFO: `/v3/projects/f26503becb8a4ce1b8ca1cfa193bf88a/users/299873208b5f41ab96778dbbcab2dc4f/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.566202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a66155-a0b1-40d5-9b16-e414a87fde53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26503becb8a4ce1b8ca1cfa193bf88a, user_id=299873208b5f41ab96778dbbcab2dc4f, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.568918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a66155-a0b1-40d5-9b16-e414a87fde53 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.582201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1266/2528] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:25 2022] PUT /identity/v3/projects/f26503becb8a4ce1b8ca1cfa193bf88a/users/299873208b5f41ab96778dbbcab2dc4f/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:25.586132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb44b30-67f4-4d46-9bbe-aa8f909758e8 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.595886 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb44b30-67f4-4d46-9bbe-aa8f909758e8 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.652658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f98b06-d283-4842-ac98-078961edf484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.653327 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f98b06-d283-4842-ac98-078961edf484 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.653606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f98b06-d283-4842-ac98-078961edf484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.653933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f98b06-d283-4842-ac98-078961edf484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.654669 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f98b06-d283-4842-ac98-078961edf484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.656301 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f98b06-d283-4842-ac98-078961edf484 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.666295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1263/2529] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:25.670869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a66155-a0b1-40d5-9b16-e414a87fde53 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.681371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a66155-a0b1-40d5-9b16-e414a87fde53 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.686985 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e1f5f-e295-4bcb-b57c-95bf49d78813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.687869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e1f5f-e295-4bcb-b57c-95bf49d78813 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.688198 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e1f5f-e295-4bcb-b57c-95bf49d78813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.688483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e1f5f-e295-4bcb-b57c-95bf49d78813 admin admin] PATH_INFO: `/v3/projects/f26503becb8a4ce1b8ca1cfa193bf88a/users/299873208b5f41ab96778dbbcab2dc4f/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.690477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e1f5f-e295-4bcb-b57c-95bf49d78813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26503becb8a4ce1b8ca1cfa193bf88a, user_id=299873208b5f41ab96778dbbcab2dc4f, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.693158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e1f5f-e295-4bcb-b57c-95bf49d78813 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.704366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1267/2530] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:25 2022] PUT /identity/v3/projects/f26503becb8a4ce1b8ca1cfa193bf88a/users/299873208b5f41ab96778dbbcab2dc4f/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:17:25.714489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1c401-fffb-4aa5-a1de-9a7fc5e47be2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.714863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1c401-fffb-4aa5-a1de-9a7fc5e47be2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.715402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1c401-fffb-4aa5-a1de-9a7fc5e47be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.741348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b1f1c401-fffb-4aa5-a1de-9a7fc5e47be2 None None] MFA Rules not processed for user `299873208b5f41ab96778dbbcab2dc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:25.743763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b1f1c401-fffb-4aa5-a1de-9a7fc5e47be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:25.815967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1264/2531] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:25.827282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e1f5f-e295-4bcb-b57c-95bf49d78813 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:25.829059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-802e1f5f-e295-4bcb-b57c-95bf49d78813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:25.885523 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e1f5f-e295-4bcb-b57c-95bf49d78813 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:25.889262 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236282ce-eb28-4f07-af71-7ce3d27fecf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:25.889905 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236282ce-eb28-4f07-af71-7ce3d27fecf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:25.890190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236282ce-eb28-4f07-af71-7ce3d27fecf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:25.890471 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236282ce-eb28-4f07-af71-7ce3d27fecf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:25.899445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236282ce-eb28-4f07-af71-7ce3d27fecf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:25.900899 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236282ce-eb28-4f07-af71-7ce3d27fecf2 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:25.910296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1268/2532] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:26.008366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1c401-fffb-4aa5-a1de-9a7fc5e47be2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:26.013806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:26.020064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1c401-fffb-4aa5-a1de-9a7fc5e47be2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:26.023826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9c4a9-9f56-4663-95b7-d6dab11d864e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:26.024515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9c4a9-9f56-4663-95b7-d6dab11d864e service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:26.024787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9c4a9-9f56-4663-95b7-d6dab11d864e service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:26.025069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9c4a9-9f56-4663-95b7-d6dab11d864e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:26.082773 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9c4a9-9f56-4663-95b7-d6dab11d864e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:26.084144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9c4a9-9f56-4663-95b7-d6dab11d864e service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:26.093210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1265/2533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:28.640407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236282ce-eb28-4f07-af71-7ce3d27fecf2 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:28.686715 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:28.705448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236282ce-eb28-4f07-af71-7ce3d27fecf2 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:28.710011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:28.710880 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:28.711161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:28.711435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] PATH_INFO: `/v3/users/cb9002353d604084aaab7e1faf5a2e0a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:28.712658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9002353d604084aaab7e1faf5a2e0a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:28.714577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:28.758913 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9002353d604084aaab7e1faf5a2e0a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:28.766378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9002353d604084aaab7e1faf5a2e0a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:28.766998 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9002353d604084aaab7e1faf5a2e0a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:28.779394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9002353d604084aaab7e1faf5a2e0a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:28.780200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9002353d604084aaab7e1faf5a2e0a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:28.792115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1269/2534] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:28 2022] DELETE /identity/v3/users/cb9002353d604084aaab7e1faf5a2e0a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:28.796822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901af303-d540-40a4-a3b7-c55a299e4a02 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:28.797282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901af303-d540-40a4-a3b7-c55a299e4a02 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:28.797378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901af303-d540-40a4-a3b7-c55a299e4a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:28.814662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-901af303-d540-40a4-a3b7-c55a299e4a02 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:28.815843 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-901af303-d540-40a4-a3b7-c55a299e4a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:28.873467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1266/2535] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:28.883570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:28.885042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:28.941662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b923-ad45-44c4-b6af-329e1fc4a3f8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:28.945491 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216f2a-c456-43dc-ad2f-b3d352c6af30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:28.946142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216f2a-c456-43dc-ad2f-b3d352c6af30 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:28.946429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216f2a-c456-43dc-ad2f-b3d352c6af30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:28.946709 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216f2a-c456-43dc-ad2f-b3d352c6af30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:28.957175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b216f2a-c456-43dc-ad2f-b3d352c6af30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:28.958631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b216f2a-c456-43dc-ad2f-b3d352c6af30 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:28.969173 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1270/2536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:29.232446 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901af303-d540-40a4-a3b7-c55a299e4a02 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:29.233887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-901af303-d540-40a4-a3b7-c55a299e4a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:29.255403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901af303-d540-40a4-a3b7-c55a299e4a02 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:29.260508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:29.262070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:29.262813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:29.263090 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] PATH_INFO: `/v3/projects/2079940be9bd4c5ea193126fa62cdc1f` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:29.264340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2079940be9bd4c5ea193126fa62cdc1f)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:29.266392 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:29.314520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2079940be9bd4c5ea193126fa62cdc1f', 'request_id': 'req-fbadde9b-7834-46cb-8754-825951505d50'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.320573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2079940be9bd4c5ea193126fa62cdc1f', 'request_id': 'req-fbadde9b-7834-46cb-8754-825951505d50'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.329810 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2079940be9bd4c5ea193126fa62cdc1f', 'request_id': 'req-fbadde9b-7834-46cb-8754-825951505d50'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.340224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] The token cache is being invalidate because project 2079940be9bd4c5ea193126fa62cdc1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:29.340501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.341142 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.342648 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1267/2537] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:29 2022] DELETE /identity/v3/projects/2079940be9bd4c5ea193126fa62cdc1f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:29.346677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216f2a-c456-43dc-ad2f-b3d352c6af30 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:29.356800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216f2a-c456-43dc-ad2f-b3d352c6af30 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:29.414235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:29.415034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:29.415320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:29.415598 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] PATH_INFO: `/v3/users/299873208b5f41ab96778dbbcab2dc4f` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:29.416817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299873208b5f41ab96778dbbcab2dc4f)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:29.418832 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:29.423258 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:29.465263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299873208b5f41ab96778dbbcab2dc4f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.472552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299873208b5f41ab96778dbbcab2dc4f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.473170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299873208b5f41ab96778dbbcab2dc4f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.485291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299873208b5f41ab96778dbbcab2dc4f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.485962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299873208b5f41ab96778dbbcab2dc4f'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.499495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1271/2538] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:29 2022] DELETE /identity/v3/users/299873208b5f41ab96778dbbcab2dc4f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:29.585868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:29.587499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:29.618468 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:29.682139 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadde9b-7834-46cb-8754-825951505d50 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:29.749724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c79ef-36a5-4768-961f-e60e00435728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:29.750376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c79ef-36a5-4768-961f-e60e00435728 service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:29.750660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c79ef-36a5-4768-961f-e60e00435728 service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:29.750933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c79ef-36a5-4768-961f-e60e00435728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:29.752750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1e1c79ef-36a5-4768-961f-e60e00435728 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:29.780695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:29.782274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:29.817673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c79ef-36a5-4768-961f-e60e00435728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:29.819262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c79ef-36a5-4768-961f-e60e00435728 service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:29.829216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1268/2539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:29.861339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868af31-224c-410a-91bc-e767cf51c742 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:29.865976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:29.866872 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:29.867152 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:29.867434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] PATH_INFO: `/v3/projects/f26503becb8a4ce1b8ca1cfa193bf88a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:29.868610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26503becb8a4ce1b8ca1cfa193bf88a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:29.870481 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:29.927070 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26503becb8a4ce1b8ca1cfa193bf88a', 'request_id': 'req-419b1ec7-0f31-4f39-b511-111b2328cfbd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.934604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26503becb8a4ce1b8ca1cfa193bf88a', 'request_id': 'req-419b1ec7-0f31-4f39-b511-111b2328cfbd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.943082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26503becb8a4ce1b8ca1cfa193bf88a', 'request_id': 'req-419b1ec7-0f31-4f39-b511-111b2328cfbd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.956630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] The token cache is being invalidate because project f26503becb8a4ce1b8ca1cfa193bf88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:29.956923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.958187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-419b1ec7-0f31-4f39-b511-111b2328cfbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:29.959768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1272/2540] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:29 2022] DELETE /identity/v3/projects/f26503becb8a4ce1b8ca1cfa193bf88a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:29.965325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240438e-4b67-4f39-a291-7288c151709e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:29.965631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240438e-4b67-4f39-a291-7288c151709e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:29.965892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240438e-4b67-4f39-a291-7288c151709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:29.983822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f240438e-4b67-4f39-a291-7288c151709e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:29.985064 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f240438e-4b67-4f39-a291-7288c151709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:30.042084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:30.051915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1269/2541] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:30.061637 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa612b-109a-4323-b445-66dbecc1e8ec None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.061979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa612b-109a-4323-b445-66dbecc1e8ec None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.062290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa612b-109a-4323-b445-66dbecc1e8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.083617 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c0aa612b-109a-4323-b445-66dbecc1e8ec None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:30.085579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c0aa612b-109a-4323-b445-66dbecc1e8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:30.095425 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1273/2542] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:30.099563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240438e-4b67-4f39-a291-7288c151709e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.114933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240438e-4b67-4f39-a291-7288c151709e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.120325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb667cde-9d14-4275-97ee-972c55b8fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.121106 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667cde-9d14-4275-97ee-972c55b8fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.121352 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667cde-9d14-4275-97ee-972c55b8fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.121746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667cde-9d14-4275-97ee-972c55b8fbc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.122494 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb667cde-9d14-4275-97ee-972c55b8fbc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:17:30.122976 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb667cde-9d14-4275-97ee-972c55b8fbc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.124634 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb667cde-9d14-4275-97ee-972c55b8fbc7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.138290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1270/2543] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:17:30.142581 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa612b-109a-4323-b445-66dbecc1e8ec None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.156827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa612b-109a-4323-b445-66dbecc1e8ec None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.161768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6e274-27cf-4392-869a-2145fb344471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.162573 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e274-27cf-4392-869a-2145fb344471 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.162878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e274-27cf-4392-869a-2145fb344471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.163156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e274-27cf-4392-869a-2145fb344471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.163858 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6e274-27cf-4392-869a-2145fb344471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.165770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6e274-27cf-4392-869a-2145fb344471 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.169826 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:30.195959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1274/2544] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:30 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:17:30.198794 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb667cde-9d14-4275-97ee-972c55b8fbc7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.209368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb667cde-9d14-4275-97ee-972c55b8fbc7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.266372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389d302-b02b-4514-9146-64dd52edca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.267044 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389d302-b02b-4514-9146-64dd52edca8b admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.267350 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389d302-b02b-4514-9146-64dd52edca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.267679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389d302-b02b-4514-9146-64dd52edca8b admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.268357 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389d302-b02b-4514-9146-64dd52edca8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.270260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389d302-b02b-4514-9146-64dd52edca8b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.290999 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1271/2545] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:30 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:30.295252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6e274-27cf-4392-869a-2145fb344471 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.305364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6e274-27cf-4392-869a-2145fb344471 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.310716 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c45f2-52d9-44f2-8e04-f22c119b6171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.311381 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c45f2-52d9-44f2-8e04-f22c119b6171 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.311667 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c45f2-52d9-44f2-8e04-f22c119b6171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.311974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c45f2-52d9-44f2-8e04-f22c119b6171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.312732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c45f2-52d9-44f2-8e04-f22c119b6171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.314323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c45f2-52d9-44f2-8e04-f22c119b6171 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.326120 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1275/2546] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:30.330076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389d302-b02b-4514-9146-64dd52edca8b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.340229 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389d302-b02b-4514-9146-64dd52edca8b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.344855 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb8a33-1696-447b-95ce-2831db3f346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.345507 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb8a33-1696-447b-95ce-2831db3f346a admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.345828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb8a33-1696-447b-95ce-2831db3f346a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.346101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb8a33-1696-447b-95ce-2831db3f346a admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.346831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb8a33-1696-447b-95ce-2831db3f346a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.348472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb8a33-1696-447b-95ce-2831db3f346a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.359482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1272/2547] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:30.363505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c45f2-52d9-44f2-8e04-f22c119b6171 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.373988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c45f2-52d9-44f2-8e04-f22c119b6171 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.378612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81c85b-5095-41d0-aab5-50a117e34870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.379821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81c85b-5095-41d0-aab5-50a117e34870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.380179 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81c85b-5095-41d0-aab5-50a117e34870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.380483 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81c85b-5095-41d0-aab5-50a117e34870 admin admin] PATH_INFO: `/v3/projects/5063f9f4711f4dc4b2963389a5708dbe/users/3efaf5b8491849a4ac1d8421477570c8/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.395304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81c85b-5095-41d0-aab5-50a117e34870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5063f9f4711f4dc4b2963389a5708dbe, user_id=3efaf5b8491849a4ac1d8421477570c8, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.397954 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81c85b-5095-41d0-aab5-50a117e34870 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.410546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1276/2548] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:30 2022] PUT /identity/v3/projects/5063f9f4711f4dc4b2963389a5708dbe/users/3efaf5b8491849a4ac1d8421477570c8/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:17:30.421595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e496e8-ad58-4870-b75a-eb986bad3a84 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.421827 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e496e8-ad58-4870-b75a-eb986bad3a84 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.422104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e496e8-ad58-4870-b75a-eb986bad3a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.449161 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-68e496e8-ad58-4870-b75a-eb986bad3a84 None None] MFA Rules not processed for user `3efaf5b8491849a4ac1d8421477570c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:30.450521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-68e496e8-ad58-4870-b75a-eb986bad3a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:30.517341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1273/2549] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:30.522282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81c85b-5095-41d0-aab5-50a117e34870 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.583868 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81c85b-5095-41d0-aab5-50a117e34870 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.589010 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813f4d-bf63-43e5-9d37-e9b20f41b5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.589722 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813f4d-bf63-43e5-9d37-e9b20f41b5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.590139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813f4d-bf63-43e5-9d37-e9b20f41b5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.590384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813f4d-bf63-43e5-9d37-e9b20f41b5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.591078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32813f4d-bf63-43e5-9d37-e9b20f41b5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.592999 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32813f4d-bf63-43e5-9d37-e9b20f41b5f2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.617625 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1277/2550] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:30 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:30.622288 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e496e8-ad58-4870-b75a-eb986bad3a84 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.632816 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e496e8-ad58-4870-b75a-eb986bad3a84 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.681351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:30.689981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966338f-7702-41ea-b29e-626ee40a5a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.690822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966338f-7702-41ea-b29e-626ee40a5a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.691109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966338f-7702-41ea-b29e-626ee40a5a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.691511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966338f-7702-41ea-b29e-626ee40a5a0b admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.692247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966338f-7702-41ea-b29e-626ee40a5a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.694196 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966338f-7702-41ea-b29e-626ee40a5a0b admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.713257 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1274/2551] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:30 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:17:30.718197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813f4d-bf63-43e5-9d37-e9b20f41b5f2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.728316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813f4d-bf63-43e5-9d37-e9b20f41b5f2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.733422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94408ee7-27c5-4ecc-86fa-f6f9f60c9a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.734077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94408ee7-27c5-4ecc-86fa-f6f9f60c9a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.734359 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94408ee7-27c5-4ecc-86fa-f6f9f60c9a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.734640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94408ee7-27c5-4ecc-86fa-f6f9f60c9a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.735370 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94408ee7-27c5-4ecc-86fa-f6f9f60c9a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.736951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94408ee7-27c5-4ecc-86fa-f6f9f60c9a25 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.747535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1278/2552] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:30.751643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966338f-7702-41ea-b29e-626ee40a5a0b admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.761769 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966338f-7702-41ea-b29e-626ee40a5a0b admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.766326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3825d-e89a-4f24-bb5e-a1488f13493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.767194 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3825d-e89a-4f24-bb5e-a1488f13493c admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.767480 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3825d-e89a-4f24-bb5e-a1488f13493c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.767758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3825d-e89a-4f24-bb5e-a1488f13493c admin admin] PATH_INFO: `/v3/projects/52c7937df70b4f8b9ac6a64ffe08e8b2/users/d996ac76300e444587cc1715db7d3ecd/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.782849 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3825d-e89a-4f24-bb5e-a1488f13493c admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c7937df70b4f8b9ac6a64ffe08e8b2, user_id=d996ac76300e444587cc1715db7d3ecd, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.785516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3825d-e89a-4f24-bb5e-a1488f13493c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.797857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1275/2553] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:30 2022] PUT /identity/v3/projects/52c7937df70b4f8b9ac6a64ffe08e8b2/users/d996ac76300e444587cc1715db7d3ecd/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:30.801776 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94408ee7-27c5-4ecc-86fa-f6f9f60c9a25 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.812659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94408ee7-27c5-4ecc-86fa-f6f9f60c9a25 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.868640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c1135-9e56-40f4-8ddd-e957da33fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.869305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c1135-9e56-40f4-8ddd-e957da33fdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.869593 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c1135-9e56-40f4-8ddd-e957da33fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.869876 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c1135-9e56-40f4-8ddd-e957da33fdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.870604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c1135-9e56-40f4-8ddd-e957da33fdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.872275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c1135-9e56-40f4-8ddd-e957da33fdb9 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.882052 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1279/2554] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:17:30.886333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3825d-e89a-4f24-bb5e-a1488f13493c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:30.896464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3825d-e89a-4f24-bb5e-a1488f13493c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:30.900991 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb5401-a62e-4e0e-b346-8646c2f6cb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:30.901854 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb5401-a62e-4e0e-b346-8646c2f6cb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.902742 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb5401-a62e-4e0e-b346-8646c2f6cb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.903025 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb5401-a62e-4e0e-b346-8646c2f6cb8e admin admin] PATH_INFO: `/v3/projects/52c7937df70b4f8b9ac6a64ffe08e8b2/users/d996ac76300e444587cc1715db7d3ecd/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.905022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb5401-a62e-4e0e-b346-8646c2f6cb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c7937df70b4f8b9ac6a64ffe08e8b2, user_id=d996ac76300e444587cc1715db7d3ecd, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:30.907619 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb5401-a62e-4e0e-b346-8646c2f6cb8e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:30.918144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1276/2555] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:30 2022] PUT /identity/v3/projects/52c7937df70b4f8b9ac6a64ffe08e8b2/users/d996ac76300e444587cc1715db7d3ecd/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:30.928129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0abb4-85b9-4ee3-b144-90035f2e6da9 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:30.928423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0abb4-85b9-4ee3-b144-90035f2e6da9 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:30.928723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0abb4-85b9-4ee3-b144-90035f2e6da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:30.954933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0fb0abb4-85b9-4ee3-b144-90035f2e6da9 None None] MFA Rules not processed for user `d996ac76300e444587cc1715db7d3ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:30.956061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0fb0abb4-85b9-4ee3-b144-90035f2e6da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:30.964007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:31.024731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1280/2556] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:31.035630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb5401-a62e-4e0e-b346-8646c2f6cb8e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:31.037333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-87cb5401-a62e-4e0e-b346-8646c2f6cb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:31.094881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb5401-a62e-4e0e-b346-8646c2f6cb8e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:31.098580 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c951b56-197d-4120-a5e7-d1e8d4a230c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:31.099214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951b56-197d-4120-a5e7-d1e8d4a230c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:31.099496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951b56-197d-4120-a5e7-d1e8d4a230c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:31.099774 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951b56-197d-4120-a5e7-d1e8d4a230c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:31.109660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c951b56-197d-4120-a5e7-d1e8d4a230c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:31.111091 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c951b56-197d-4120-a5e7-d1e8d4a230c1 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:31.120830 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1277/2557] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:31.248320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0abb4-85b9-4ee3-b144-90035f2e6da9 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:31.312984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0abb4-85b9-4ee3-b144-90035f2e6da9 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:31.317650 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:31.318518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:31.318821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:31.319099 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] PATH_INFO: `/v3/users/3efaf5b8491849a4ac1d8421477570c8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:31.320307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3efaf5b8491849a4ac1d8421477570c8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:31.322537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:31.375156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3efaf5b8491849a4ac1d8421477570c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.382940 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3efaf5b8491849a4ac1d8421477570c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.383810 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3efaf5b8491849a4ac1d8421477570c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.397020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3efaf5b8491849a4ac1d8421477570c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.397730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3efaf5b8491849a4ac1d8421477570c8'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.410520 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1281/2558] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:31 2022] DELETE /identity/v3/users/3efaf5b8491849a4ac1d8421477570c8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:31.415065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d6fc-021b-46b8-8583-8049457f1088 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:31.415359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d6fc-021b-46b8-8583-8049457f1088 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:31.415846 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d6fc-021b-46b8-8583-8049457f1088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:31.434632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c826d6fc-021b-46b8-8583-8049457f1088 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:31.436001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c826d6fc-021b-46b8-8583-8049457f1088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:31.507339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1278/2559] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:31.515048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:31.516913 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:31.548009 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:31.583300 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64945ea9-8e2a-48ef-acd9-4d90b7fcb524 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:31.587127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437f8be-31e0-48a4-b0b1-612c28dddba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:31.587784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437f8be-31e0-48a4-b0b1-612c28dddba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:31.588119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437f8be-31e0-48a4-b0b1-612c28dddba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:31.588611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437f8be-31e0-48a4-b0b1-612c28dddba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:31.598272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437f8be-31e0-48a4-b0b1-612c28dddba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:31.599704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437f8be-31e0-48a4-b0b1-612c28dddba6 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:31.610199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1282/2560] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:31.840867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826d6fc-021b-46b8-8583-8049457f1088 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:31.842279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c826d6fc-021b-46b8-8583-8049457f1088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:31.889836 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437f8be-31e0-48a4-b0b1-612c28dddba6 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:31.892271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7437f8be-31e0-48a4-b0b1-612c28dddba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:31.906537 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437f8be-31e0-48a4-b0b1-612c28dddba6 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:31.907022 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:31.912350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:31.914273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:31.914701 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:31.915154 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] PATH_INFO: `/v3/projects/5063f9f4711f4dc4b2963389a5708dbe` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:31.916857 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5063f9f4711f4dc4b2963389a5708dbe)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:31.919446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:31.940498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826d6fc-021b-46b8-8583-8049457f1088 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:31.946133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa8e78-0495-4e29-8547-549e0e82b47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:31.946780 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa8e78-0495-4e29-8547-549e0e82b47b service nova] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:31.947146 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa8e78-0495-4e29-8547-549e0e82b47b service nova] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:31.947431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa8e78-0495-4e29-8547-549e0e82b47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:31.950473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3afa8e78-0495-4e29-8547-549e0e82b47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:31.968274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5063f9f4711f4dc4b2963389a5708dbe', 'request_id': 'req-271a344d-7cc7-42f7-92f9-f58a029d1bc5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.974415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5063f9f4711f4dc4b2963389a5708dbe', 'request_id': 'req-271a344d-7cc7-42f7-92f9-f58a029d1bc5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.980814 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5063f9f4711f4dc4b2963389a5708dbe', 'request_id': 'req-271a344d-7cc7-42f7-92f9-f58a029d1bc5'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.995633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] The token cache is being invalidate because project 5063f9f4711f4dc4b2963389a5708dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:31.996027 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.996672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:31.998219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1283/2561] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:31 2022] DELETE /identity/v3/projects/5063f9f4711f4dc4b2963389a5708dbe => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:17:32.002187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:32.003513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:32.016131 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa8e78-0495-4e29-8547-549e0e82b47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:32.017730 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa8e78-0495-4e29-8547-549e0e82b47b service nova] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:32.027542 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1279/2562] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:32.070228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a344d-7cc7-42f7-92f9-f58a029d1bc5 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:32.076022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:32.076946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:32.077112 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:32.077393 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] PATH_INFO: `/v3/users/d996ac76300e444587cc1715db7d3ecd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:32.078599 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d996ac76300e444587cc1715db7d3ecd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:32.080551 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:32.131782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd996ac76300e444587cc1715db7d3ecd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.135424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:32.140378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd996ac76300e444587cc1715db7d3ecd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.141442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd996ac76300e444587cc1715db7d3ecd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.156100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd996ac76300e444587cc1715db7d3ecd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.156903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-f038962a-2d91-463d-8f37-ac5bec8ae831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd996ac76300e444587cc1715db7d3ecd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.169417 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1284/2563] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:32 2022] DELETE /identity/v3/users/d996ac76300e444587cc1715db7d3ecd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:17:32.478156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa8e78-0495-4e29-8547-549e0e82b47b service nova] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:32.494885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa8e78-0495-4e29-8547-549e0e82b47b service nova] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:32.552629 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:32.553481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:32.553764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:32.554040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] PATH_INFO: `/v3/projects/52c7937df70b4f8b9ac6a64ffe08e8b2` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:32.555197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c7937df70b4f8b9ac6a64ffe08e8b2)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:32.557123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:32.603249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c7937df70b4f8b9ac6a64ffe08e8b2', 'request_id': 'req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.610214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c7937df70b4f8b9ac6a64ffe08e8b2', 'request_id': 'req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.617821 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c7937df70b4f8b9ac6a64ffe08e8b2', 'request_id': 'req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.630118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] The token cache is being invalidate because project 52c7937df70b4f8b9ac6a64ffe08e8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:32.630411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.631060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-04e5eb0f-6bc1-4b0c-8071-3cc77c6ec048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:32.632835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1280/2564] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:32 2022] DELETE /identity/v3/projects/52c7937df70b4f8b9ac6a64ffe08e8b2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:32.638092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdc5bf-1db3-4c74-839d-fe714aab1a68 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:32.638458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdc5bf-1db3-4c74-839d-fe714aab1a68 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:32.638807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdc5bf-1db3-4c74-839d-fe714aab1a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:32.658088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d7cdc5bf-1db3-4c74-839d-fe714aab1a68 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:32.659403 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d7cdc5bf-1db3-4c74-839d-fe714aab1a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:32.721340 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1285/2565] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:17:32.729024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c6993-6162-440a-b7d4-a431e9563873 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:32.729318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c6993-6162-440a-b7d4-a431e9563873 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:32.729630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c6993-6162-440a-b7d4-a431e9563873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:32.748933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-038c6993-6162-440a-b7d4-a431e9563873 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:32.750172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-038c6993-6162-440a-b7d4-a431e9563873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:32.758375 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1281/2566] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:17:32.763305 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdc5bf-1db3-4c74-839d-fe714aab1a68 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:32.773061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdc5bf-1db3-4c74-839d-fe714aab1a68 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:32.777987 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c54e-029e-44f3-8316-1b42d1ed5055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:32.778655 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c54e-029e-44f3-8316-1b42d1ed5055 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:32.778943 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c54e-029e-44f3-8316-1b42d1ed5055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:32.779224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c54e-029e-44f3-8316-1b42d1ed5055 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:32.779996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7c54e-029e-44f3-8316-1b42d1ed5055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:17:32.780308 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7c54e-029e-44f3-8316-1b42d1ed5055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:32.781909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7c54e-029e-44f3-8316-1b42d1ed5055 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:32.795119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1286/2567] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:17:32.799503 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c6993-6162-440a-b7d4-a431e9563873 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:32.809397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c6993-6162-440a-b7d4-a431e9563873 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:32.814256 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18edb5-ebb3-42f8-9ab7-9f18c78a3705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:32.814940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18edb5-ebb3-42f8-9ab7-9f18c78a3705 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:32.815226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18edb5-ebb3-42f8-9ab7-9f18c78a3705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:32.815504 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18edb5-ebb3-42f8-9ab7-9f18c78a3705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:32.816219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18edb5-ebb3-42f8-9ab7-9f18c78a3705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:32.818115 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18edb5-ebb3-42f8-9ab7-9f18c78a3705 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:32.828891 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:32.849809 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1282/2568] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:32 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:32.853945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c54e-029e-44f3-8316-1b42d1ed5055 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:32.863929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c54e-029e-44f3-8316-1b42d1ed5055 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:32.919816 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499119c-1df0-4af7-a199-92deaca1f37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:32.920529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499119c-1df0-4af7-a199-92deaca1f37b admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:32.920817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499119c-1df0-4af7-a199-92deaca1f37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:32.921092 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499119c-1df0-4af7-a199-92deaca1f37b admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:32.921809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499119c-1df0-4af7-a199-92deaca1f37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:32.923684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499119c-1df0-4af7-a199-92deaca1f37b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:32.943337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1287/2569] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:32 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:17:32.947494 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18edb5-ebb3-42f8-9ab7-9f18c78a3705 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:32.958103 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18edb5-ebb3-42f8-9ab7-9f18c78a3705 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:32.962624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63de21-ae45-412d-b241-ac110f1bce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:32.963272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63de21-ae45-412d-b241-ac110f1bce09 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:32.963554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63de21-ae45-412d-b241-ac110f1bce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:32.963828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63de21-ae45-412d-b241-ac110f1bce09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:32.965179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63de21-ae45-412d-b241-ac110f1bce09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:32.967086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63de21-ae45-412d-b241-ac110f1bce09 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:32.976765 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1283/2570] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:32.981137 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499119c-1df0-4af7-a199-92deaca1f37b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:32.991080 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499119c-1df0-4af7-a199-92deaca1f37b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:32.995681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520748c6-e4de-40b5-83b8-42ed288d8ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:32.996377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520748c6-e4de-40b5-83b8-42ed288d8ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:32.996658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520748c6-e4de-40b5-83b8-42ed288d8ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:32.996932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520748c6-e4de-40b5-83b8-42ed288d8ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:32.997648 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520748c6-e4de-40b5-83b8-42ed288d8ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:32.999244 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520748c6-e4de-40b5-83b8-42ed288d8ebb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:33.009475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1288/2571] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:33.013797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63de21-ae45-412d-b241-ac110f1bce09 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:33.023642 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63de21-ae45-412d-b241-ac110f1bce09 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:33.028980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3be787-f63c-422a-84c8-5d8a37f8b8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:33.029845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be787-f63c-422a-84c8-5d8a37f8b8db admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.030134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be787-f63c-422a-84c8-5d8a37f8b8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.030408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be787-f63c-422a-84c8-5d8a37f8b8db admin admin] PATH_INFO: `/v3/projects/37a54fc294624337b438d36f74c1da2d/users/9bfb073682bd4839b2a403c32f394cbd/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.045224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3be787-f63c-422a-84c8-5d8a37f8b8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a54fc294624337b438d36f74c1da2d, user_id=9bfb073682bd4839b2a403c32f394cbd, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:33.047844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3be787-f63c-422a-84c8-5d8a37f8b8db admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:33.061057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1284/2572] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:33 2022] PUT /identity/v3/projects/37a54fc294624337b438d36f74c1da2d/users/9bfb073682bd4839b2a403c32f394cbd/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:17:33.071361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee03ea7-94ee-44df-9b8d-9771c359ab7b None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.071653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee03ea7-94ee-44df-9b8d-9771c359ab7b None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.071960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee03ea7-94ee-44df-9b8d-9771c359ab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.098746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3ee03ea7-94ee-44df-9b8d-9771c359ab7b None None] MFA Rules not processed for user `9bfb073682bd4839b2a403c32f394cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:33.099974 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3ee03ea7-94ee-44df-9b8d-9771c359ab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:33.124574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:33.166644 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1289/2573] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:33.171618 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3be787-f63c-422a-84c8-5d8a37f8b8db admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:33.231865 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3be787-f63c-422a-84c8-5d8a37f8b8db admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:33.236516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213f0cc-031b-4d66-b86c-0a3b5c0bb22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:33.237165 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213f0cc-031b-4d66-b86c-0a3b5c0bb22a admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.237451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213f0cc-031b-4d66-b86c-0a3b5c0bb22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.237728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213f0cc-031b-4d66-b86c-0a3b5c0bb22a admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.238417 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213f0cc-031b-4d66-b86c-0a3b5c0bb22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:33.240362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213f0cc-031b-4d66-b86c-0a3b5c0bb22a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:33.265717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1285/2574] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:33 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:33.270118 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee03ea7-94ee-44df-9b8d-9771c359ab7b None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:33.282201 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee03ea7-94ee-44df-9b8d-9771c359ab7b None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:33.337484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ad997-6154-42a8-8944-1ef7dff5188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:33.338148 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ad997-6154-42a8-8944-1ef7dff5188a admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.338431 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ad997-6154-42a8-8944-1ef7dff5188a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.338706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ad997-6154-42a8-8944-1ef7dff5188a admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.339574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ad997-6154-42a8-8944-1ef7dff5188a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:33.341586 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ad997-6154-42a8-8944-1ef7dff5188a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:33.365590 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1290/2575] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:33 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:17:33.366773 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213f0cc-031b-4d66-b86c-0a3b5c0bb22a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:33.377913 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213f0cc-031b-4d66-b86c-0a3b5c0bb22a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:33.382896 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dad2a-b347-4880-b591-ea8690f64cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:33.383533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dad2a-b347-4880-b591-ea8690f64cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.383873 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dad2a-b347-4880-b591-ea8690f64cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.384185 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dad2a-b347-4880-b591-ea8690f64cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.384903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dad2a-b347-4880-b591-ea8690f64cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:33.386656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dad2a-b347-4880-b591-ea8690f64cc1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:33.397360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1286/2576] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:33.401371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ad997-6154-42a8-8944-1ef7dff5188a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:33.411383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ad997-6154-42a8-8944-1ef7dff5188a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:33.424964 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230db82-2c03-47a5-9ce7-0f46a4085e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:33.425863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230db82-2c03-47a5-9ce7-0f46a4085e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.426145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230db82-2c03-47a5-9ce7-0f46a4085e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.426422 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230db82-2c03-47a5-9ce7-0f46a4085e79 admin admin] PATH_INFO: `/v3/projects/5e9de4bf08504430a396943e83511309/users/57d5ad9ef1b548d687bdfc272d1bd28c/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.442723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230db82-2c03-47a5-9ce7-0f46a4085e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9de4bf08504430a396943e83511309, user_id=57d5ad9ef1b548d687bdfc272d1bd28c, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:33.445390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230db82-2c03-47a5-9ce7-0f46a4085e79 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:33.459059 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1291/2577] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:33 2022] PUT /identity/v3/projects/5e9de4bf08504430a396943e83511309/users/57d5ad9ef1b548d687bdfc272d1bd28c/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:33.463072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dad2a-b347-4880-b591-ea8690f64cc1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:33.473069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dad2a-b347-4880-b591-ea8690f64cc1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:33.529897 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d4ea8-b56e-421c-ba9d-44e1819839df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:33.530479 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4ea8-b56e-421c-ba9d-44e1819839df admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.530764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4ea8-b56e-421c-ba9d-44e1819839df admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.531041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4ea8-b56e-421c-ba9d-44e1819839df admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.531768 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d4ea8-b56e-421c-ba9d-44e1819839df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:33.533406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d4ea8-b56e-421c-ba9d-44e1819839df admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:33.543802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1287/2578] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:33.547958 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230db82-2c03-47a5-9ce7-0f46a4085e79 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:33.558751 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230db82-2c03-47a5-9ce7-0f46a4085e79 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:33.563780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093fa4e-4ac3-4015-82f8-a2c2dceae472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:33.564753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093fa4e-4ac3-4015-82f8-a2c2dceae472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.565040 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093fa4e-4ac3-4015-82f8-a2c2dceae472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.565321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093fa4e-4ac3-4015-82f8-a2c2dceae472 admin admin] PATH_INFO: `/v3/projects/5e9de4bf08504430a396943e83511309/users/57d5ad9ef1b548d687bdfc272d1bd28c/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.567372 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093fa4e-4ac3-4015-82f8-a2c2dceae472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9de4bf08504430a396943e83511309, user_id=57d5ad9ef1b548d687bdfc272d1bd28c, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:33.570116 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093fa4e-4ac3-4015-82f8-a2c2dceae472 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:33.580935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1292/2579] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:33 2022] PUT /identity/v3/projects/5e9de4bf08504430a396943e83511309/users/57d5ad9ef1b548d687bdfc272d1bd28c/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:33.592487 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c07b2a-08b9-4865-ad77-b0313298f35d None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.592776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c07b2a-08b9-4865-ad77-b0313298f35d None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.593055 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c07b2a-08b9-4865-ad77-b0313298f35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.619889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-f0c07b2a-08b9-4865-ad77-b0313298f35d None None] MFA Rules not processed for user `57d5ad9ef1b548d687bdfc272d1bd28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:33.622251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f0c07b2a-08b9-4865-ad77-b0313298f35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:33.634688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:33.693432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1288/2580] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:33.705134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093fa4e-4ac3-4015-82f8-a2c2dceae472 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:33.706929 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-4093fa4e-4ac3-4015-82f8-a2c2dceae472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:33.767809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093fa4e-4ac3-4015-82f8-a2c2dceae472 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:33.771530 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76830f71-8c16-4c29-809a-4246a781209a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:33.772216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830f71-8c16-4c29-809a-4246a781209a service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:33.772632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830f71-8c16-4c29-809a-4246a781209a service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:33.772921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830f71-8c16-4c29-809a-4246a781209a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:33.785048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76830f71-8c16-4c29-809a-4246a781209a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:33.785902 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76830f71-8c16-4c29-809a-4246a781209a service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:33.795989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1293/2581] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:34.040104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c07b2a-08b9-4865-ad77-b0313298f35d None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:34.059394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c07b2a-08b9-4865-ad77-b0313298f35d None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:34.063516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb375e1-3891-4629-b076-e66b9ea9b588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:34.064325 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb375e1-3891-4629-b076-e66b9ea9b588 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:34.064708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb375e1-3891-4629-b076-e66b9ea9b588 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:34.065082 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb375e1-3891-4629-b076-e66b9ea9b588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:34.131264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb375e1-3891-4629-b076-e66b9ea9b588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:34.132861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb375e1-3891-4629-b076-e66b9ea9b588 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:34.142578 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1289/2582] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:38.805993 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76830f71-8c16-4c29-809a-4246a781209a service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:38.828215 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:38.872364 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76830f71-8c16-4c29-809a-4246a781209a service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:38.877622 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:38.878631 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:38.878853 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:38.879156 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] PATH_INFO: `/v3/users/9bfb073682bd4839b2a403c32f394cbd` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:38.880592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bfb073682bd4839b2a403c32f394cbd)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:38.882611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:38.931058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bfb073682bd4839b2a403c32f394cbd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:38.938979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bfb073682bd4839b2a403c32f394cbd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:38.939624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bfb073682bd4839b2a403c32f394cbd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:38.954071 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bfb073682bd4839b2a403c32f394cbd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:38.954772 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bfb073682bd4839b2a403c32f394cbd'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:38.967453 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1294/2583] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:38 2022] DELETE /identity/v3/users/9bfb073682bd4839b2a403c32f394cbd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:38.972554 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddc3c4-bb24-457f-9296-605d003f0f0f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:38.973066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddc3c4-bb24-457f-9296-605d003f0f0f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:38.973153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddc3c4-bb24-457f-9296-605d003f0f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:38.991987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-16ddc3c4-bb24-457f-9296-605d003f0f0f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:38.993213 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-16ddc3c4-bb24-457f-9296-605d003f0f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:39.053702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1290/2584] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:39.063482 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:39.064919 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:39.122248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80129-66d7-4442-b72b-00227ac3c965 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:39.126296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdc72b-c7c4-4400-a13b-4826cbfcf2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:39.126952 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdc72b-c7c4-4400-a13b-4826cbfcf2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:39.127241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdc72b-c7c4-4400-a13b-4826cbfcf2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:39.127522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdc72b-c7c4-4400-a13b-4826cbfcf2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:39.136723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdc72b-c7c4-4400-a13b-4826cbfcf2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:39.138143 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdc72b-c7c4-4400-a13b-4826cbfcf2b6 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:39.149452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1295/2585] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:39.438557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddc3c4-bb24-457f-9296-605d003f0f0f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:39.440353 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-16ddc3c4-bb24-457f-9296-605d003f0f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:39.454894 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddc3c4-bb24-457f-9296-605d003f0f0f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:39.460237 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:39.461122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:39.461413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:39.461697 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] PATH_INFO: `/v3/projects/37a54fc294624337b438d36f74c1da2d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:39.463172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a54fc294624337b438d36f74c1da2d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:39.465603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:39.514482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:39.518942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a54fc294624337b438d36f74c1da2d', 'request_id': 'req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.525599 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a54fc294624337b438d36f74c1da2d', 'request_id': 'req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.536863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a54fc294624337b438d36f74c1da2d', 'request_id': 'req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.548748 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] The token cache is being invalidate because project 37a54fc294624337b438d36f74c1da2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:39.549042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.549763 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.551511 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1291/2586] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:39 2022] DELETE /identity/v3/projects/37a54fc294624337b438d36f74c1da2d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:39.555641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdc72b-c7c4-4400-a13b-4826cbfcf2b6 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:39.565782 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdc72b-c7c4-4400-a13b-4826cbfcf2b6 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:39.608211 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:39.628304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:39.629182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:39.629465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:39.629739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] PATH_INFO: `/v3/users/57d5ad9ef1b548d687bdfc272d1bd28c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:39.630925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d5ad9ef1b548d687bdfc272d1bd28c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:39.632867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:39.684421 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d5ad9ef1b548d687bdfc272d1bd28c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.692270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d5ad9ef1b548d687bdfc272d1bd28c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.693026 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d5ad9ef1b548d687bdfc272d1bd28c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.705946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d5ad9ef1b548d687bdfc272d1bd28c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.706643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-7e7b49ae-4e5a-4068-a7f1-a26f5729418c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d5ad9ef1b548d687bdfc272d1bd28c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:39.719511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1296/2587] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:39 2022] DELETE /identity/v3/users/57d5ad9ef1b548d687bdfc272d1bd28c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:40.004995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:40.007080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:40.025724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e53fa-ecaa-482a-abd8-81cc552c36f8 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:40.086212 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:40.087089 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.087373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.087656 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] PATH_INFO: `/v3/projects/5e9de4bf08504430a396943e83511309` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.088889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9de4bf08504430a396943e83511309)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:40.090801 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:40.139614 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9de4bf08504430a396943e83511309', 'request_id': 'req-0078eeb2-e55e-44e5-83a6-a23f97c0562a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:40.145756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9de4bf08504430a396943e83511309', 'request_id': 'req-0078eeb2-e55e-44e5-83a6-a23f97c0562a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:40.152547 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9de4bf08504430a396943e83511309', 'request_id': 'req-0078eeb2-e55e-44e5-83a6-a23f97c0562a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:40.163362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] The token cache is being invalidate because project 5e9de4bf08504430a396943e83511309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:40.163654 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:40.164302 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-0078eeb2-e55e-44e5-83a6-a23f97c0562a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:40.165832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1292/2588] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:40 2022] DELETE /identity/v3/projects/5e9de4bf08504430a396943e83511309 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:40.171323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7ac52-c3a0-44cd-aa03-f3b181d6cce2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.172014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7ac52-c3a0-44cd-aa03-f3b181d6cce2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.172014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7ac52-c3a0-44cd-aa03-f3b181d6cce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.190367 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-cfa7ac52-c3a0-44cd-aa03-f3b181d6cce2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:40.191569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cfa7ac52-c3a0-44cd-aa03-f3b181d6cce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:40.250164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1297/2589] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:40.257912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57da8-8225-42ec-adcc-65843eb83ca2 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.258205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57da8-8225-42ec-adcc-65843eb83ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.258489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57da8-8225-42ec-adcc-65843eb83ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.276639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-cef57da8-8225-42ec-adcc-65843eb83ca2 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:40.277839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-cef57da8-8225-42ec-adcc-65843eb83ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:40.286498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1293/2590] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:40.290735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7ac52-c3a0-44cd-aa03-f3b181d6cce2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:40.300662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7ac52-c3a0-44cd-aa03-f3b181d6cce2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:40.305310 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c7631-6a1b-4180-a7a5-ee7c24ad5d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:40.305991 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c7631-6a1b-4180-a7a5-ee7c24ad5d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.306278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c7631-6a1b-4180-a7a5-ee7c24ad5d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.306558 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c7631-6a1b-4180-a7a5-ee7c24ad5d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.307316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c7631-6a1b-4180-a7a5-ee7c24ad5d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:17:40.307646 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c7631-6a1b-4180-a7a5-ee7c24ad5d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:40.309268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c7631-6a1b-4180-a7a5-ee7c24ad5d8a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:40.320694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1298/2591] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:17:40.324864 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57da8-8225-42ec-adcc-65843eb83ca2 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:40.335282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57da8-8225-42ec-adcc-65843eb83ca2 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:40.339963 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a1f3d-dde6-476e-a1cc-19eeb891ee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:40.340623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a1f3d-dde6-476e-a1cc-19eeb891ee1f admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.340911 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a1f3d-dde6-476e-a1cc-19eeb891ee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.341192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a1f3d-dde6-476e-a1cc-19eeb891ee1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.341915 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a1f3d-dde6-476e-a1cc-19eeb891ee1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:40.344929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a1f3d-dde6-476e-a1cc-19eeb891ee1f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:40.369559 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1294/2592] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:40 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:40.373692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c7631-6a1b-4180-a7a5-ee7c24ad5d8a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:40.384241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c7631-6a1b-4180-a7a5-ee7c24ad5d8a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:40.430196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:40.443345 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e094be-c4c9-404a-9963-ba0080597e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:40.444053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e094be-c4c9-404a-9963-ba0080597e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.444342 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e094be-c4c9-404a-9963-ba0080597e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.444621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e094be-c4c9-404a-9963-ba0080597e19 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.445337 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e094be-c4c9-404a-9963-ba0080597e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:40.447271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e094be-c4c9-404a-9963-ba0080597e19 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:40.466589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1299/2593] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:40 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:40.471674 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a1f3d-dde6-476e-a1cc-19eeb891ee1f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:40.482148 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a1f3d-dde6-476e-a1cc-19eeb891ee1f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:40.487539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb0d03-cf6f-4350-a63e-9537782d66c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:40.488235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb0d03-cf6f-4350-a63e-9537782d66c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.488520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb0d03-cf6f-4350-a63e-9537782d66c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.488797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb0d03-cf6f-4350-a63e-9537782d66c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.489522 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb0d03-cf6f-4350-a63e-9537782d66c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:40.491109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb0d03-cf6f-4350-a63e-9537782d66c6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:40.502407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1295/2594] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:40.506418 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e094be-c4c9-404a-9963-ba0080597e19 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:40.516841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e094be-c4c9-404a-9963-ba0080597e19 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:40.521510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c6b0-9d34-49ac-b839-0836d044b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:40.522174 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c6b0-9d34-49ac-b839-0836d044b71e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.522475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c6b0-9d34-49ac-b839-0836d044b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.522745 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c6b0-9d34-49ac-b839-0836d044b71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.523476 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18c6b0-9d34-49ac-b839-0836d044b71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:40.525180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18c6b0-9d34-49ac-b839-0836d044b71e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:40.536188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1300/2595] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:40.540162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb0d03-cf6f-4350-a63e-9537782d66c6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:40.552207 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb0d03-cf6f-4350-a63e-9537782d66c6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:40.557147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03b69c-b454-47a5-8d5f-3f914506fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:40.558032 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03b69c-b454-47a5-8d5f-3f914506fdb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.558318 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03b69c-b454-47a5-8d5f-3f914506fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.558603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03b69c-b454-47a5-8d5f-3f914506fdb6 admin admin] PATH_INFO: `/v3/projects/462775ef3927449483c54ae84a30cf7a/users/e3c029ae41b5428bb5d2bc4c12b4fde2/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.577198 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03b69c-b454-47a5-8d5f-3f914506fdb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462775ef3927449483c54ae84a30cf7a, user_id=e3c029ae41b5428bb5d2bc4c12b4fde2, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:40.579844 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03b69c-b454-47a5-8d5f-3f914506fdb6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:40.588655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:40.597797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1296/2596] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:40 2022] PUT /identity/v3/projects/462775ef3927449483c54ae84a30cf7a/users/e3c029ae41b5428bb5d2bc4c12b4fde2/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:40.610161 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c684-c004-4545-bea2-5c42522721d8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.610450 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c684-c004-4545-bea2-5c42522721d8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.610729 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c684-c004-4545-bea2-5c42522721d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.638140 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-19a7c684-c004-4545-bea2-5c42522721d8 None None] MFA Rules not processed for user `e3c029ae41b5428bb5d2bc4c12b4fde2`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:40.639360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-19a7c684-c004-4545-bea2-5c42522721d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:40.710806 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1301/2597] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:40.730004 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03b69c-b454-47a5-8d5f-3f914506fdb6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:40.731971 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4c03b69c-b454-47a5-8d5f-3f914506fdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:40.806571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03b69c-b454-47a5-8d5f-3f914506fdb6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:40.810327 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1e528-df5e-45da-bacc-c0b9091fde33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:40.810985 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1e528-df5e-45da-bacc-c0b9091fde33 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:40.811272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1e528-df5e-45da-bacc-c0b9091fde33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:40.812017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1e528-df5e-45da-bacc-c0b9091fde33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:40.820857 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1e528-df5e-45da-bacc-c0b9091fde33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:40.822466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1e528-df5e-45da-bacc-c0b9091fde33 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:40.833710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1297/2598] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:43.971565 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7c684-c004-4545-bea2-5c42522721d8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:43.973129 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-19a7c684-c004-4545-bea2-5c42522721d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:44.133649 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7c684-c004-4545-bea2-5c42522721d8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:44.152058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0fc7f-a520-4f1d-947d-6588aa9d8661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:44.152783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0fc7f-a520-4f1d-947d-6588aa9d8661 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:44.153134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0fc7f-a520-4f1d-947d-6588aa9d8661 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:44.157910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0fc7f-a520-4f1d-947d-6588aa9d8661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:44.160426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-80b0fc7f-a520-4f1d-947d-6588aa9d8661 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:44.180194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0fc7f-a520-4f1d-947d-6588aa9d8661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:44.182360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0fc7f-a520-4f1d-947d-6588aa9d8661 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:44.195445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1302/2599] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:46.282413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1e528-df5e-45da-bacc-c0b9091fde33 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:46.343836 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1e528-df5e-45da-bacc-c0b9091fde33 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:46.348422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:46.349282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:46.349565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:46.349840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] PATH_INFO: `/v3/users/e3c029ae41b5428bb5d2bc4c12b4fde2` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:46.351030 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c029ae41b5428bb5d2bc4c12b4fde2)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:46.352993 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:46.398404 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c029ae41b5428bb5d2bc4c12b4fde2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:46.405681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c029ae41b5428bb5d2bc4c12b4fde2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:46.417378 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c029ae41b5428bb5d2bc4c12b4fde2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:46.418008 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c029ae41b5428bb5d2bc4c12b4fde2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:46.418641 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c029ae41b5428bb5d2bc4c12b4fde2'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:46.430561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1298/2600] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:46 2022] DELETE /identity/v3/users/e3c029ae41b5428bb5d2bc4c12b4fde2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:46.435076 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8c71-cd5d-4d35-b0b9-140a2d70baad None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:46.435571 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8c71-cd5d-4d35-b0b9-140a2d70baad None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:46.435665 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8c71-cd5d-4d35-b0b9-140a2d70baad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:46.454058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c14a8c71-cd5d-4d35-b0b9-140a2d70baad None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:46.455542 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c14a8c71-cd5d-4d35-b0b9-140a2d70baad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:46.499428 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:46.523443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1303/2601] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:46.533326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:46.534732 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:46.556192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:46.594647 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6de0c-af5f-4308-bb7a-b21fc6aca22f admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:46.598396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaa544-7b14-41f8-84a7-96fcd7b64bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:46.599048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaa544-7b14-41f8-84a7-96fcd7b64bcb service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:46.599368 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaa544-7b14-41f8-84a7-96fcd7b64bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:46.599756 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaa544-7b14-41f8-84a7-96fcd7b64bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:46.609300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaa544-7b14-41f8-84a7-96fcd7b64bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:46.610777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaa544-7b14-41f8-84a7-96fcd7b64bcb service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:46.621181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1299/2602] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:46.919878 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8c71-cd5d-4d35-b0b9-140a2d70baad None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:46.922192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c14a8c71-cd5d-4d35-b0b9-140a2d70baad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:46.936841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8c71-cd5d-4d35-b0b9-140a2d70baad None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:46.942984 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:46.943626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:46.944001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:46.944397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] PATH_INFO: `/v3/projects/462775ef3927449483c54ae84a30cf7a` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:46.945835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462775ef3927449483c54ae84a30cf7a)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:46.948216 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:47.000838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462775ef3927449483c54ae84a30cf7a', 'request_id': 'req-583c49fb-ead9-476a-843f-7325f8bdbe78'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:47.007317 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462775ef3927449483c54ae84a30cf7a', 'request_id': 'req-583c49fb-ead9-476a-843f-7325f8bdbe78'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:47.012855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462775ef3927449483c54ae84a30cf7a', 'request_id': 'req-583c49fb-ead9-476a-843f-7325f8bdbe78'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:47.024976 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] The token cache is being invalidate because project 462775ef3927449483c54ae84a30cf7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:47.025271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:47.025932 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-583c49fb-ead9-476a-843f-7325f8bdbe78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:47.027503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1304/2603] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:46 2022] DELETE /identity/v3/projects/462775ef3927449483c54ae84a30cf7a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:47.033407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f34b-7267-4ed8-9e63-865ca8081cb8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.033706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f34b-7267-4ed8-9e63-865ca8081cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.033994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f34b-7267-4ed8-9e63-865ca8081cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.052333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-bea4f34b-7267-4ed8-9e63-865ca8081cb8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:47.053608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-bea4f34b-7267-4ed8-9e63-865ca8081cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:47.117622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1300/2604] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:47.181706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a204-fadc-4075-b527-8c3864fcfbc7 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.182014 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a204-fadc-4075-b527-8c3864fcfbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.182302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a204-fadc-4075-b527-8c3864fcfbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.201060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3fe2a204-fadc-4075-b527-8c3864fcfbc7 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:47.202613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3fe2a204-fadc-4075-b527-8c3864fcfbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:47.210807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1305/2605] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:47.214874 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4f34b-7267-4ed8-9e63-865ca8081cb8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:47.225799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4f34b-7267-4ed8-9e63-865ca8081cb8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:47.230320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb26865-0578-4a57-9168-5c324ecb637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:47.230967 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb26865-0578-4a57-9168-5c324ecb637a admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.231251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb26865-0578-4a57-9168-5c324ecb637a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.231527 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb26865-0578-4a57-9168-5c324ecb637a admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.232285 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb26865-0578-4a57-9168-5c324ecb637a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:17:47.232593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb26865-0578-4a57-9168-5c324ecb637a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:47.234903 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb26865-0578-4a57-9168-5c324ecb637a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:47.246386 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1301/2606] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:17:47.250681 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2a204-fadc-4075-b527-8c3864fcfbc7 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:47.259704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2a204-fadc-4075-b527-8c3864fcfbc7 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:47.264674 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a64c8-05e3-45f4-8cfc-9269dd5245e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:47.265021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a64c8-05e3-45f4-8cfc-9269dd5245e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.265302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a64c8-05e3-45f4-8cfc-9269dd5245e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.265579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a64c8-05e3-45f4-8cfc-9269dd5245e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.266268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a64c8-05e3-45f4-8cfc-9269dd5245e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:47.268163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a64c8-05e3-45f4-8cfc-9269dd5245e1 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:47.292701 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1306/2607] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:47 2022] POST /identity/v3/projects => generated 367 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:17:47.296929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb26865-0578-4a57-9168-5c324ecb637a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:47.307102 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb26865-0578-4a57-9168-5c324ecb637a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:47.364171 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299950e2-6cc4-4141-a086-abcd22e66482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:47.364837 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299950e2-6cc4-4141-a086-abcd22e66482 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.365122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299950e2-6cc4-4141-a086-abcd22e66482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.365402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299950e2-6cc4-4141-a086-abcd22e66482 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.366092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299950e2-6cc4-4141-a086-abcd22e66482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:47.368033 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299950e2-6cc4-4141-a086-abcd22e66482 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:47.387088 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1302/2608] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:47 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:47.391205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a64c8-05e3-45f4-8cfc-9269dd5245e1 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:47.401545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a64c8-05e3-45f4-8cfc-9269dd5245e1 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:47.406778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3d66b-a42b-4b07-ab33-be813c2bc954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:47.407435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3d66b-a42b-4b07-ab33-be813c2bc954 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.407724 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3d66b-a42b-4b07-ab33-be813c2bc954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.408038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3d66b-a42b-4b07-ab33-be813c2bc954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.408768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3d66b-a42b-4b07-ab33-be813c2bc954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:47.410352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3d66b-a42b-4b07-ab33-be813c2bc954 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:47.421445 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1307/2609] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:47.425275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299950e2-6cc4-4141-a086-abcd22e66482 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:47.435451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299950e2-6cc4-4141-a086-abcd22e66482 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:47.440549 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbe08b-1544-4d17-ad47-7afd658b7a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:47.441206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbe08b-1544-4d17-ad47-7afd658b7a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.441496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbe08b-1544-4d17-ad47-7afd658b7a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.441780 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbe08b-1544-4d17-ad47-7afd658b7a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.442508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbe08b-1544-4d17-ad47-7afd658b7a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:47.444136 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbe08b-1544-4d17-ad47-7afd658b7a6e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:47.454741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1303/2610] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:47.458660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3d66b-a42b-4b07-ab33-be813c2bc954 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:47.469088 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3d66b-a42b-4b07-ab33-be813c2bc954 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:47.473705 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9c054-ac76-4936-9160-382d7592469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:47.474583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9c054-ac76-4936-9160-382d7592469e admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.474869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9c054-ac76-4936-9160-382d7592469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.475147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9c054-ac76-4936-9160-382d7592469e admin admin] PATH_INFO: `/v3/projects/38fdbf4a463545ecb37b4184b5db764d/users/5cd43cd88bb74af880f060249ad8d142/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.491624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9c054-ac76-4936-9160-382d7592469e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fdbf4a463545ecb37b4184b5db764d, user_id=5cd43cd88bb74af880f060249ad8d142, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:47.494321 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9c054-ac76-4936-9160-382d7592469e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:47.509978 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1308/2611] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:47 2022] PUT /identity/v3/projects/38fdbf4a463545ecb37b4184b5db764d/users/5cd43cd88bb74af880f060249ad8d142/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:47.522117 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90174-d4b2-4dbf-869d-572e1faddf69 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.522455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90174-d4b2-4dbf-869d-572e1faddf69 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.522734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90174-d4b2-4dbf-869d-572e1faddf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.550907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2ae90174-d4b2-4dbf-869d-572e1faddf69 None None] MFA Rules not processed for user `5cd43cd88bb74af880f060249ad8d142`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:47.552224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2ae90174-d4b2-4dbf-869d-572e1faddf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:47.569278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:47.620835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1304/2612] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:17:47.632253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9c054-ac76-4936-9160-382d7592469e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:47.633941 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-48a9c054-ac76-4936-9160-382d7592469e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:47.693492 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9c054-ac76-4936-9160-382d7592469e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:47.697177 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82867-c300-482d-984a-5286a13a83b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7d9cfbbcd4068aa9241ffd694c631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:47.697834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82867-c300-482d-984a-5286a13a83b4 service glance] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.698125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82867-c300-482d-984a-5286a13a83b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.698410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82867-c300-482d-984a-5286a13a83b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.709079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da82867-c300-482d-984a-5286a13a83b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:47.710508 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da82867-c300-482d-984a-5286a13a83b4 service glance] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:47.720812 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1309/2613] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:47.814577 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60213ce1-013d-4f2c-a561-d8852a42cebd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:47.814877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60213ce1-013d-4f2c-a561-d8852a42cebd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:47.815162 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60213ce1-013d-4f2c-a561-d8852a42cebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:47.844372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-60213ce1-013d-4f2c-a561-d8852a42cebd None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:47.845500 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-60213ce1-013d-4f2c-a561-d8852a42cebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:47.915380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1305/2614] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:47.985788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82867-c300-482d-984a-5286a13a83b4 service glance] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:47.987455 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-6da82867-c300-482d-984a-5286a13a83b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:48.000896 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:48.122443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82867-c300-482d-984a-5286a13a83b4 service glance] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:48.129034 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b5bcc-eb56-47c3-b73a-47cc61a54bbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:48.130079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b5bcc-eb56-47c3-b73a-47cc61a54bbc service swift] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:48.130685 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b5bcc-eb56-47c3-b73a-47cc61a54bbc service swift] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:48.131223 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b5bcc-eb56-47c3-b73a-47cc61a54bbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:48.144477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b5bcc-eb56-47c3-b73a-47cc61a54bbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:48.146669 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b5bcc-eb56-47c3-b73a-47cc61a54bbc service swift] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:48.158458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1310/2615] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:17:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:17:49.207784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60213ce1-013d-4f2c-a561-d8852a42cebd None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:49.209684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-60213ce1-013d-4f2c-a561-d8852a42cebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:49.290095 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60213ce1-013d-4f2c-a561-d8852a42cebd None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:49.294283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:49.294953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:49.295775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:49.296560 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:49.298496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:49.398408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:49.400241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:49.421253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1306/2616] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:50.184682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b5bcc-eb56-47c3-b73a-47cc61a54bbc service swift] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:50.186230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-419b5bcc-eb56-47c3-b73a-47cc61a54bbc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:50.340792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b5bcc-eb56-47c3-b73a-47cc61a54bbc service swift] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:50.348632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32abe8-ddc0-4bbe-9cd1-0ce3d987393e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:50.349301 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32abe8-ddc0-4bbe-9cd1-0ce3d987393e service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:50.349592 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32abe8-ddc0-4bbe-9cd1-0ce3d987393e service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:50.349873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32abe8-ddc0-4bbe-9cd1-0ce3d987393e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:50.351712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-ce32abe8-ddc0-4bbe-9cd1-0ce3d987393e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:50.368251 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32abe8-ddc0-4bbe-9cd1-0ce3d987393e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:50.371022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32abe8-ddc0-4bbe-9cd1-0ce3d987393e service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:50.388486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1311/2617] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:53.652878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:53.652878 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:53.679235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f795-e731-45d0-94a7-9042d3c1a6e9 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:53.692684 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:53.693710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:53.694098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:53.694476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] PATH_INFO: `/v3/users/e5a2ca1c3b1b43cd9c9fe090d2d41cbf` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:53.695831 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a2ca1c3b1b43cd9c9fe090d2d41cbf)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:53.697898 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:53.706231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:53.772222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a2ca1c3b1b43cd9c9fe090d2d41cbf'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:53.785556 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a2ca1c3b1b43cd9c9fe090d2d41cbf'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:53.799922 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a2ca1c3b1b43cd9c9fe090d2d41cbf'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:53.800718 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a2ca1c3b1b43cd9c9fe090d2d41cbf'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:53.801484 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-90c89485-19ac-460b-a263-cd722c0ac029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a2ca1c3b1b43cd9c9fe090d2d41cbf'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:53.822514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1307/2618] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:53 2022] DELETE /identity/v3/users/e5a2ca1c3b1b43cd9c9fe090d2d41cbf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:54.057840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32abe8-ddc0-4bbe-9cd1-0ce3d987393e service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:54.082946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32abe8-ddc0-4bbe-9cd1-0ce3d987393e service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:54.163921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:54.164961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.165314 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.165662 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] PATH_INFO: `/v3/projects/f23ed984bddd49f0904553ce84e5e8d8` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.166968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23ed984bddd49f0904553ce84e5e8d8)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:54.169057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:54.202158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:54.237569 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23ed984bddd49f0904553ce84e5e8d8', 'request_id': 'req-90322341-99c5-4e68-9aeb-16749a93a37a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:54.245543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23ed984bddd49f0904553ce84e5e8d8', 'request_id': 'req-90322341-99c5-4e68-9aeb-16749a93a37a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:54.264307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23ed984bddd49f0904553ce84e5e8d8', 'request_id': 'req-90322341-99c5-4e68-9aeb-16749a93a37a'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:54.282735 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] The token cache is being invalidate because project f23ed984bddd49f0904553ce84e5e8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:54.283037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:54.283693 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-90322341-99c5-4e68-9aeb-16749a93a37a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:54.285333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1312/2619] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:54 2022] DELETE /identity/v3/projects/f23ed984bddd49f0904553ce84e5e8d8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:54.290466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcd811-e498-4a5e-aebc-acf67c7a969b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.290930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcd811-e498-4a5e-aebc-acf67c7a969b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.291314 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcd811-e498-4a5e-aebc-acf67c7a969b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.336176 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-87fcd811-e498-4a5e-aebc-acf67c7a969b None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:54.337609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-87fcd811-e498-4a5e-aebc-acf67c7a969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:54.419835 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1308/2620] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:54.430064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17f2e7-fb07-4a09-96b3-4b05be79510c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.430376 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17f2e7-fb07-4a09-96b3-4b05be79510c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.430707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17f2e7-fb07-4a09-96b3-4b05be79510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.449624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7d17f2e7-fb07-4a09-96b3-4b05be79510c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:54.451136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7d17f2e7-fb07-4a09-96b3-4b05be79510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:54.460446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1313/2621] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:54.464467 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcd811-e498-4a5e-aebc-acf67c7a969b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:54.475701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcd811-e498-4a5e-aebc-acf67c7a969b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:54.480808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b581-f4e7-490c-85fa-b26d1c3d0153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:54.481523 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b581-f4e7-490c-85fa-b26d1c3d0153 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.481814 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b581-f4e7-490c-85fa-b26d1c3d0153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.482101 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b581-f4e7-490c-85fa-b26d1c3d0153 admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.483563 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31b581-f4e7-490c-85fa-b26d1c3d0153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:17:54.484081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31b581-f4e7-490c-85fa-b26d1c3d0153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:54.485736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31b581-f4e7-490c-85fa-b26d1c3d0153 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:54.500027 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1309/2622] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:17:54.504572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17f2e7-fb07-4a09-96b3-4b05be79510c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:54.515146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17f2e7-fb07-4a09-96b3-4b05be79510c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:54.522886 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414748-efa4-4d69-b66c-390ad69c98a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:54.523582 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414748-efa4-4d69-b66c-390ad69c98a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.523873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414748-efa4-4d69-b66c-390ad69c98a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.524181 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414748-efa4-4d69-b66c-390ad69c98a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.524893 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4414748-efa4-4d69-b66c-390ad69c98a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:54.527057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4414748-efa4-4d69-b66c-390ad69c98a2 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:54.574200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1314/2623] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:54 2022] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:54.575639 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b581-f4e7-490c-85fa-b26d1c3d0153 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:54.590521 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b581-f4e7-490c-85fa-b26d1c3d0153 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:54.674539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699e732-4151-4d74-8dd5-ae9e0c3ec0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:54.675235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699e732-4151-4d74-8dd5-ae9e0c3ec0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.675499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699e732-4151-4d74-8dd5-ae9e0c3ec0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.675776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699e732-4151-4d74-8dd5-ae9e0c3ec0f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.676565 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699e732-4151-4d74-8dd5-ae9e0c3ec0f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:54.678745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699e732-4151-4d74-8dd5-ae9e0c3ec0f4 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:54.710636 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1310/2624] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:54 2022] POST /identity/v3/users => generated 282 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:17:54.717909 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414748-efa4-4d69-b66c-390ad69c98a2 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:54.728959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414748-efa4-4d69-b66c-390ad69c98a2 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:54.735780 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46957a93-deea-4ea2-94a9-7e4f7e046c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:54.736508 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46957a93-deea-4ea2-94a9-7e4f7e046c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.736800 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46957a93-deea-4ea2-94a9-7e4f7e046c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.737084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46957a93-deea-4ea2-94a9-7e4f7e046c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.739463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46957a93-deea-4ea2-94a9-7e4f7e046c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:54.741312 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46957a93-deea-4ea2-94a9-7e4f7e046c52 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:54.768951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1315/2625] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:54.773039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699e732-4151-4d74-8dd5-ae9e0c3ec0f4 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:54.783492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:54.791075 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699e732-4151-4d74-8dd5-ae9e0c3ec0f4 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:54.797081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202c36a-4ec9-4841-a621-2fe26215d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:54.797776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202c36a-4ec9-4841-a621-2fe26215d97e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.798210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202c36a-4ec9-4841-a621-2fe26215d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.798375 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202c36a-4ec9-4841-a621-2fe26215d97e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.799057 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202c36a-4ec9-4841-a621-2fe26215d97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:54.800719 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202c36a-4ec9-4841-a621-2fe26215d97e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:54.819655 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1311/2626] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:54.821057 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46957a93-deea-4ea2-94a9-7e4f7e046c52 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:54.833124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46957a93-deea-4ea2-94a9-7e4f7e046c52 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:54.838265 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254e83f-71c0-4f17-87c8-a772cf4732ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:54.839222 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254e83f-71c0-4f17-87c8-a772cf4732ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.839802 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254e83f-71c0-4f17-87c8-a772cf4732ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.840172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254e83f-71c0-4f17-87c8-a772cf4732ff admin admin] PATH_INFO: `/v3/projects/1a636114163341c8a1a4fac5779c6f8f/users/fa2123c8f8514000b46292d6b957973e/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.859325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254e83f-71c0-4f17-87c8-a772cf4732ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a636114163341c8a1a4fac5779c6f8f, user_id=fa2123c8f8514000b46292d6b957973e, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:54.862330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254e83f-71c0-4f17-87c8-a772cf4732ff admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:54.880713 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1316/2627] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:54 2022] PUT /identity/v3/projects/1a636114163341c8a1a4fac5779c6f8f/users/fa2123c8f8514000b46292d6b957973e/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:54.891699 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55c8a-b925-4052-a09a-ac1290d99119 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:54.892298 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55c8a-b925-4052-a09a-ac1290d99119 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:54.892842 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55c8a-b925-4052-a09a-ac1290d99119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:54.930508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-57d55c8a-b925-4052-a09a-ac1290d99119 None None] MFA Rules not processed for user `fa2123c8f8514000b46292d6b957973e`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:54.931824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-57d55c8a-b925-4052-a09a-ac1290d99119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:55.034649 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1312/2628] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:55.039269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254e83f-71c0-4f17-87c8-a772cf4732ff admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:55.136651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254e83f-71c0-4f17-87c8-a772cf4732ff admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:55.141570 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a3e31-fc20-4f7d-a4eb-16832b781095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:55.142231 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a3e31-fc20-4f7d-a4eb-16832b781095 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:55.142517 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a3e31-fc20-4f7d-a4eb-16832b781095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:55.142793 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a3e31-fc20-4f7d-a4eb-16832b781095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:55.143487 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a3e31-fc20-4f7d-a4eb-16832b781095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:55.149082 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a3e31-fc20-4f7d-a4eb-16832b781095 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:55.188802 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1317/2629] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:17:55 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:17:55.193158 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55c8a-b925-4052-a09a-ac1290d99119 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:55.205269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55c8a-b925-4052-a09a-ac1290d99119 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:55.280209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80dbbd-178c-42c0-be17-9fc32686e54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:55.281724 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80dbbd-178c-42c0-be17-9fc32686e54c admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:55.283228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80dbbd-178c-42c0-be17-9fc32686e54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:55.283959 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80dbbd-178c-42c0-be17-9fc32686e54c admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:55.284848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80dbbd-178c-42c0-be17-9fc32686e54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:55.287015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80dbbd-178c-42c0-be17-9fc32686e54c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:55.321761 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1313/2630] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:17:55 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:17:55.326719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a3e31-fc20-4f7d-a4eb-16832b781095 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:55.346900 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a3e31-fc20-4f7d-a4eb-16832b781095 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:55.353714 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910d199-7223-49b8-809e-c9895da6ed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:55.355397 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910d199-7223-49b8-809e-c9895da6ed1e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:55.355770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910d199-7223-49b8-809e-c9895da6ed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:55.356098 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910d199-7223-49b8-809e-c9895da6ed1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:55.357248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910d199-7223-49b8-809e-c9895da6ed1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:55.360333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910d199-7223-49b8-809e-c9895da6ed1e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:55.377630 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1318/2631] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:55.380932 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80dbbd-178c-42c0-be17-9fc32686e54c admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:55.398824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80dbbd-178c-42c0-be17-9fc32686e54c admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:55.412953 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c0942-5361-4ca0-be4d-1327bed2f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:55.414210 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c0942-5361-4ca0-be4d-1327bed2f6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:55.414497 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c0942-5361-4ca0-be4d-1327bed2f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:55.415600 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c0942-5361-4ca0-be4d-1327bed2f6cb admin admin] PATH_INFO: `/v3/projects/0cbbef85b7d748b5902373514305154b/users/ac59037c6b7c4536ad3f71a311f5ca32/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:55.434309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c0942-5361-4ca0-be4d-1327bed2f6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbbef85b7d748b5902373514305154b, user_id=ac59037c6b7c4536ad3f71a311f5ca32, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:55.437141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c0942-5361-4ca0-be4d-1327bed2f6cb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:55.465529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1314/2632] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:55 2022] PUT /identity/v3/projects/0cbbef85b7d748b5902373514305154b/users/ac59037c6b7c4536ad3f71a311f5ca32/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:55.471921 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910d199-7223-49b8-809e-c9895da6ed1e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:55.483997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910d199-7223-49b8-809e-c9895da6ed1e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:55.512235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:55.594778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81e6a7-dcb4-42b7-bb93-f0e318bb8b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:55.595611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81e6a7-dcb4-42b7-bb93-f0e318bb8b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:55.596339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81e6a7-dcb4-42b7-bb93-f0e318bb8b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:55.596556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81e6a7-dcb4-42b7-bb93-f0e318bb8b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:55.597703 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81e6a7-dcb4-42b7-bb93-f0e318bb8b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:55.599322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81e6a7-dcb4-42b7-bb93-f0e318bb8b38 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:55.616175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1319/2633] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:17:55.617965 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c0942-5361-4ca0-be4d-1327bed2f6cb admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:55.630099 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c0942-5361-4ca0-be4d-1327bed2f6cb admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:55.635491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345fa96-1138-4a2f-9b6d-06a1a3919cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:55.636520 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345fa96-1138-4a2f-9b6d-06a1a3919cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:55.636901 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345fa96-1138-4a2f-9b6d-06a1a3919cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:55.637274 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345fa96-1138-4a2f-9b6d-06a1a3919cd7 admin admin] PATH_INFO: `/v3/projects/0cbbef85b7d748b5902373514305154b/users/ac59037c6b7c4536ad3f71a311f5ca32/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:55.639602 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345fa96-1138-4a2f-9b6d-06a1a3919cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbbef85b7d748b5902373514305154b, user_id=ac59037c6b7c4536ad3f71a311f5ca32, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:55.642529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345fa96-1138-4a2f-9b6d-06a1a3919cd7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:55.659679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1315/2634] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:17:55 2022] PUT /identity/v3/projects/0cbbef85b7d748b5902373514305154b/users/ac59037c6b7c4536ad3f71a311f5ca32/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:55.673972 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3b10-509d-4c2b-8c7f-209733d3aefb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:55.674543 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3b10-509d-4c2b-8c7f-209733d3aefb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:55.675157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3b10-509d-4c2b-8c7f-209733d3aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:55.714251 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3e7d3b10-509d-4c2b-8c7f-209733d3aefb None None] MFA Rules not processed for user `ac59037c6b7c4536ad3f71a311f5ca32`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:55.716157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3e7d3b10-509d-4c2b-8c7f-209733d3aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:55.830441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1320/2635] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:17:55.844408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345fa96-1138-4a2f-9b6d-06a1a3919cd7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:55.860540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3345fa96-1138-4a2f-9b6d-06a1a3919cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:55.921291 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:55.962701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345fa96-1138-4a2f-9b6d-06a1a3919cd7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:55.977987 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea01af-0655-4093-82fc-f2716327547a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:55.978776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea01af-0655-4093-82fc-f2716327547a service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:55.979071 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea01af-0655-4093-82fc-f2716327547a service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:55.979353 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea01af-0655-4093-82fc-f2716327547a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:55.990680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea01af-0655-4093-82fc-f2716327547a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:55.992180 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea01af-0655-4093-82fc-f2716327547a service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:56.004240 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1316/2636] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:56.121105 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3b10-509d-4c2b-8c7f-209733d3aefb None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:56.133212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3b10-509d-4c2b-8c7f-209733d3aefb None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:56.141624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ab8c-fc63-4504-80a0-b7d1c35015dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:56.143768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ab8c-fc63-4504-80a0-b7d1c35015dc service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:56.143768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ab8c-fc63-4504-80a0-b7d1c35015dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:56.143768 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ab8c-fc63-4504-80a0-b7d1c35015dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:56.225125 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3ab8c-fc63-4504-80a0-b7d1c35015dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:56.226545 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3ab8c-fc63-4504-80a0-b7d1c35015dc service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:56.239949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1321/2637] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:59.088781 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea01af-0655-4093-82fc-f2716327547a service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:59.152492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea01af-0655-4093-82fc-f2716327547a service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:59.157558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:59.158430 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:59.158713 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:59.158990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] PATH_INFO: `/v3/users/fa2123c8f8514000b46292d6b957973e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:59.160193 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2123c8f8514000b46292d6b957973e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:59.162093 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:59.210679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2123c8f8514000b46292d6b957973e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.218333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2123c8f8514000b46292d6b957973e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.230863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2123c8f8514000b46292d6b957973e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.231573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2123c8f8514000b46292d6b957973e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.232255 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2123c8f8514000b46292d6b957973e'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.245787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1317/2638] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:59 2022] DELETE /identity/v3/users/fa2123c8f8514000b46292d6b957973e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:59.250825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7756e-de70-4e04-8b11-e8051f2251a8 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:59.251290 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7756e-de70-4e04-8b11-e8051f2251a8 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:59.251464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7756e-de70-4e04-8b11-e8051f2251a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:59.273058 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-1cb7756e-de70-4e04-8b11-e8051f2251a8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:17:59.274499 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1cb7756e-de70-4e04-8b11-e8051f2251a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:59.312165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:59.338937 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1322/2639] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:17:59.349113 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:59.350604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:59.409601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a45014-227b-456e-8c75-af1dc6252cdd admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:59.413610 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41ef36-e120-425b-b83c-61a52d74a18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:59.414340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41ef36-e120-425b-b83c-61a52d74a18a service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:59.414726 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41ef36-e120-425b-b83c-61a52d74a18a service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:59.415097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41ef36-e120-425b-b83c-61a52d74a18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:59.425187 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41ef36-e120-425b-b83c-61a52d74a18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:59.426603 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41ef36-e120-425b-b83c-61a52d74a18a service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:59.430457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:17:59.438553 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1318/2640] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:59.484951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7756e-de70-4e04-8b11-e8051f2251a8 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:59.486513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1cb7756e-de70-4e04-8b11-e8051f2251a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:59.499086 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7756e-de70-4e04-8b11-e8051f2251a8 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:59.502961 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6823271-be58-4940-80e8-e264ad0dddee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:59.503613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823271-be58-4940-80e8-e264ad0dddee service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:59.503924 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823271-be58-4940-80e8-e264ad0dddee service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:59.504536 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823271-be58-4940-80e8-e264ad0dddee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:59.506309 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c6823271-be58-4940-80e8-e264ad0dddee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:59.518018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6823271-be58-4940-80e8-e264ad0dddee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:59.519466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6823271-be58-4940-80e8-e264ad0dddee service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:59.528078 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1323/2641] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:17:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:17:59.806862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41ef36-e120-425b-b83c-61a52d74a18a service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:59.808478 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fc41ef36-e120-425b-b83c-61a52d74a18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:17:59.823536 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41ef36-e120-425b-b83c-61a52d74a18a service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:17:59.829625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:17:59.830501 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:17:59.830889 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:17:59.831270 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] PATH_INFO: `/v3/projects/1a636114163341c8a1a4fac5779c6f8f` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:17:59.832664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a636114163341c8a1a4fac5779c6f8f)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:17:59.834808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:17:59.890369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a636114163341c8a1a4fac5779c6f8f', 'request_id': 'req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.897084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a636114163341c8a1a4fac5779c6f8f', 'request_id': 'req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.907329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a636114163341c8a1a4fac5779c6f8f', 'request_id': 'req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.920557 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] The token cache is being invalidate because project 1a636114163341c8a1a4fac5779c6f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:17:59.920847 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.921514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:17:59.923299 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1319/2642] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:17:59 2022] DELETE /identity/v3/projects/1a636114163341c8a1a4fac5779c6f8f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:17:59.927158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6823271-be58-4940-80e8-e264ad0dddee service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:17:59.939527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6823271-be58-4940-80e8-e264ad0dddee service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:00.003953 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:00.004913 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:00.005199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:00.005535 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] PATH_INFO: `/v3/users/ac59037c6b7c4536ad3f71a311f5ca32` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:00.006781 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac59037c6b7c4536ad3f71a311f5ca32)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:00.008764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:00.057533 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac59037c6b7c4536ad3f71a311f5ca32'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.066757 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac59037c6b7c4536ad3f71a311f5ca32'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.067360 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac59037c6b7c4536ad3f71a311f5ca32'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.080409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac59037c6b7c4536ad3f71a311f5ca32'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.081079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8c53c924-a8b9-4b46-99bb-ba2c077b0765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac59037c6b7c4536ad3f71a311f5ca32'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.094450 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1324/2643] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:17:59 2022] DELETE /identity/v3/users/ac59037c6b7c4536ad3f71a311f5ca32 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:00.549470 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:00.550897 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:00.568701 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b571d7-71d5-4ac0-ad17-ff53f8e67c66 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:00.636534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:00.637408 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:00.637696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:00.637995 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] PATH_INFO: `/v3/projects/0cbbef85b7d748b5902373514305154b` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:00.639662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbbef85b7d748b5902373514305154b)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:00.641632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:00.690788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbbef85b7d748b5902373514305154b', 'request_id': 'req-adfc74e3-792b-4eb9-b04b-de7d474a7a91'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.697211 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbbef85b7d748b5902373514305154b', 'request_id': 'req-adfc74e3-792b-4eb9-b04b-de7d474a7a91'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.704776 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbbef85b7d748b5902373514305154b', 'request_id': 'req-adfc74e3-792b-4eb9-b04b-de7d474a7a91'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.715271 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] The token cache is being invalidate because project 0cbbef85b7d748b5902373514305154b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:00.715561 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.716254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-adfc74e3-792b-4eb9-b04b-de7d474a7a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:00.718372 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1320/2644] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:00 2022] DELETE /identity/v3/projects/0cbbef85b7d748b5902373514305154b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:00.724273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7368e-096c-4877-88a8-028b4e2f4666 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:00.724763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7368e-096c-4877-88a8-028b4e2f4666 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:00.724910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7368e-096c-4877-88a8-028b4e2f4666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:00.743409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-97b7368e-096c-4877-88a8-028b4e2f4666 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:00.744647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-97b7368e-096c-4877-88a8-028b4e2f4666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:00.788114 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:00.808107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1325/2645] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:00.817787 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6520bc-bedd-4117-82bf-467dbfe8ca41 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:00.818080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6520bc-bedd-4117-82bf-467dbfe8ca41 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:00.818365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6520bc-bedd-4117-82bf-467dbfe8ca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:00.838506 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7b6520bc-bedd-4117-82bf-467dbfe8ca41 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:00.839760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7b6520bc-bedd-4117-82bf-467dbfe8ca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:00.847886 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1321/2646] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:00.852198 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7368e-096c-4877-88a8-028b4e2f4666 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:00.862601 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7368e-096c-4877-88a8-028b4e2f4666 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:00.867172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3c556-814b-4287-83ac-f0a07e25b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:00.867846 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c556-814b-4287-83ac-f0a07e25b48a admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:00.868160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c556-814b-4287-83ac-f0a07e25b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:00.868440 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c556-814b-4287-83ac-f0a07e25b48a admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:00.869172 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3c556-814b-4287-83ac-f0a07e25b48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:18:00.869480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3c556-814b-4287-83ac-f0a07e25b48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:00.871060 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3c556-814b-4287-83ac-f0a07e25b48a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:00.887400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1326/2647] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:18:00.889320 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6520bc-bedd-4117-82bf-467dbfe8ca41 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:00.894966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:00.899182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6520bc-bedd-4117-82bf-467dbfe8ca41 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:00.905734 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc5b1-8fbf-4a7b-a0d0-744f38afd234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:00.906461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc5b1-8fbf-4a7b-a0d0-744f38afd234 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:00.906750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc5b1-8fbf-4a7b-a0d0-744f38afd234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:00.907029 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc5b1-8fbf-4a7b-a0d0-744f38afd234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:00.907892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcc5b1-8fbf-4a7b-a0d0-744f38afd234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:00.910096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcc5b1-8fbf-4a7b-a0d0-744f38afd234 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:00.939326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1322/2648] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:18:00 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:18:00.943529 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3c556-814b-4287-83ac-f0a07e25b48a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:00.954246 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3c556-814b-4287-83ac-f0a07e25b48a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.014518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d07883-1097-44c4-9325-79a97915656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.015270 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d07883-1097-44c4-9325-79a97915656c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.015555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d07883-1097-44c4-9325-79a97915656c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.015834 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d07883-1097-44c4-9325-79a97915656c admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.016555 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d07883-1097-44c4-9325-79a97915656c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.018485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d07883-1097-44c4-9325-79a97915656c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.038521 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1327/2649] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:18:00 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:01.042721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc5b1-8fbf-4a7b-a0d0-744f38afd234 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.054146 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc5b1-8fbf-4a7b-a0d0-744f38afd234 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.058980 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b72e07-32fc-49bc-b5a7-32c14c2c7d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.059582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b72e07-32fc-49bc-b5a7-32c14c2c7d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.059867 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b72e07-32fc-49bc-b5a7-32c14c2c7d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.060822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b72e07-32fc-49bc-b5a7-32c14c2c7d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.061558 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b72e07-32fc-49bc-b5a7-32c14c2c7d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.063275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b72e07-32fc-49bc-b5a7-32c14c2c7d3d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.074094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1323/2650] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:01.078489 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d07883-1097-44c4-9325-79a97915656c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.088432 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d07883-1097-44c4-9325-79a97915656c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.093350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fadd96-2bdb-4fcc-99d7-a555667e38f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.094023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fadd96-2bdb-4fcc-99d7-a555667e38f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.094313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fadd96-2bdb-4fcc-99d7-a555667e38f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.094594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fadd96-2bdb-4fcc-99d7-a555667e38f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.095334 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fadd96-2bdb-4fcc-99d7-a555667e38f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.096990 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fadd96-2bdb-4fcc-99d7-a555667e38f8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.107556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1328/2651] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:01.111749 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b72e07-32fc-49bc-b5a7-32c14c2c7d3d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.122044 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b72e07-32fc-49bc-b5a7-32c14c2c7d3d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.127736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24665-7f5f-480d-8eb3-70152e552e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.128653 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24665-7f5f-480d-8eb3-70152e552e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.128938 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24665-7f5f-480d-8eb3-70152e552e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.129214 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24665-7f5f-480d-8eb3-70152e552e0e admin admin] PATH_INFO: `/v3/projects/82866e9c434843689ca8a1cbff26d52f/users/ed496c8a2e2b4ebfba0f4acdbd5b26a6/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.145082 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d24665-7f5f-480d-8eb3-70152e552e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82866e9c434843689ca8a1cbff26d52f, user_id=ed496c8a2e2b4ebfba0f4acdbd5b26a6, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.147708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d24665-7f5f-480d-8eb3-70152e552e0e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.160396 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1324/2652] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:01 2022] PUT /identity/v3/projects/82866e9c434843689ca8a1cbff26d52f/users/ed496c8a2e2b4ebfba0f4acdbd5b26a6/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:01.171263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdc568-8cb5-4f43-8eb0-16ff0a308a72 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.171560 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdc568-8cb5-4f43-8eb0-16ff0a308a72 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.171867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdc568-8cb5-4f43-8eb0-16ff0a308a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.198296 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-54bdc568-8cb5-4f43-8eb0-16ff0a308a72 None None] MFA Rules not processed for user `ed496c8a2e2b4ebfba0f4acdbd5b26a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:01.199509 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-54bdc568-8cb5-4f43-8eb0-16ff0a308a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:01.263041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1329/2653] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:18:01.267609 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24665-7f5f-480d-8eb3-70152e552e0e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.327576 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24665-7f5f-480d-8eb3-70152e552e0e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.332266 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7935d1c-5ecd-4d44-8153-4cf6e0b6847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.333108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935d1c-5ecd-4d44-8153-4cf6e0b6847e admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.333276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935d1c-5ecd-4d44-8153-4cf6e0b6847e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.333538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935d1c-5ecd-4d44-8153-4cf6e0b6847e admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.334228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7935d1c-5ecd-4d44-8153-4cf6e0b6847e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.336140 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7935d1c-5ecd-4d44-8153-4cf6e0b6847e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.363203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1325/2654] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:18:01 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:01.367259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdc568-8cb5-4f43-8eb0-16ff0a308a72 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.379127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdc568-8cb5-4f43-8eb0-16ff0a308a72 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.421378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:01.438933 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7204d-09b6-429d-95ae-26a68a4ad8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.439615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7204d-09b6-429d-95ae-26a68a4ad8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.439923 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7204d-09b6-429d-95ae-26a68a4ad8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.440224 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7204d-09b6-429d-95ae-26a68a4ad8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.440927 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7204d-09b6-429d-95ae-26a68a4ad8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.442829 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7204d-09b6-429d-95ae-26a68a4ad8b0 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.479102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1330/2655] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:18:01 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:01.480356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7935d1c-5ecd-4d44-8153-4cf6e0b6847e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.492328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7935d1c-5ecd-4d44-8153-4cf6e0b6847e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.498163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d0e34-f321-4904-911e-68a4ec86dd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.498828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d0e34-f321-4904-911e-68a4ec86dd51 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.499104 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d0e34-f321-4904-911e-68a4ec86dd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.499380 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d0e34-f321-4904-911e-68a4ec86dd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.500216 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d0e34-f321-4904-911e-68a4ec86dd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.501803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d0e34-f321-4904-911e-68a4ec86dd51 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.513009 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1326/2656] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:01.517486 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7204d-09b6-429d-95ae-26a68a4ad8b0 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.528091 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7204d-09b6-429d-95ae-26a68a4ad8b0 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.533801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91c0e-5857-4523-81c9-0897ab5aa341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.534689 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91c0e-5857-4523-81c9-0897ab5aa341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.534979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91c0e-5857-4523-81c9-0897ab5aa341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.535259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91c0e-5857-4523-81c9-0897ab5aa341 admin admin] PATH_INFO: `/v3/projects/f4108fee851444b7b4eed8343c214c0e/users/4b16630cb95c4e0fb1f2c689b4411214/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.551100 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd91c0e-5857-4523-81c9-0897ab5aa341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4108fee851444b7b4eed8343c214c0e, user_id=4b16630cb95c4e0fb1f2c689b4411214, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.553791 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd91c0e-5857-4523-81c9-0897ab5aa341 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.566685 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1331/2657] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:01 2022] PUT /identity/v3/projects/f4108fee851444b7b4eed8343c214c0e/users/4b16630cb95c4e0fb1f2c689b4411214/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:01.570664 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d0e34-f321-4904-911e-68a4ec86dd51 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.582729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d0e34-f321-4904-911e-68a4ec86dd51 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.656203 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96745e72-330f-4927-97ac-e35bfffbc964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.656882 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96745e72-330f-4927-97ac-e35bfffbc964 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.657166 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96745e72-330f-4927-97ac-e35bfffbc964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.657444 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96745e72-330f-4927-97ac-e35bfffbc964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.658232 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96745e72-330f-4927-97ac-e35bfffbc964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.659877 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96745e72-330f-4927-97ac-e35bfffbc964 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.672509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1327/2658] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:18:01.676301 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91c0e-5857-4523-81c9-0897ab5aa341 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.692505 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91c0e-5857-4523-81c9-0897ab5aa341 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.698788 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428384da-b3e4-4055-8def-4c0df0af2b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.708200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428384da-b3e4-4055-8def-4c0df0af2b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.708200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428384da-b3e4-4055-8def-4c0df0af2b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.708200 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428384da-b3e4-4055-8def-4c0df0af2b3a admin admin] PATH_INFO: `/v3/projects/f4108fee851444b7b4eed8343c214c0e/users/4b16630cb95c4e0fb1f2c689b4411214/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.710876 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428384da-b3e4-4055-8def-4c0df0af2b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4108fee851444b7b4eed8343c214c0e, user_id=4b16630cb95c4e0fb1f2c689b4411214, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.713621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428384da-b3e4-4055-8def-4c0df0af2b3a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.727191 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1332/2659] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:01 2022] PUT /identity/v3/projects/f4108fee851444b7b4eed8343c214c0e/users/4b16630cb95c4e0fb1f2c689b4411214/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:01.741039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5fa08-1a89-4367-b6ce-469caab01cac None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.741336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5fa08-1a89-4367-b6ce-469caab01cac None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.741613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5fa08-1a89-4367-b6ce-469caab01cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.773838 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-17e5fa08-1a89-4367-b6ce-469caab01cac None None] MFA Rules not processed for user `4b16630cb95c4e0fb1f2c689b4411214`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:01.775251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-17e5fa08-1a89-4367-b6ce-469caab01cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:01.781137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:01.848605 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1328/2660] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:01.861011 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428384da-b3e4-4055-8def-4c0df0af2b3a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:01.863041 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-428384da-b3e4-4055-8def-4c0df0af2b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:01.920898 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428384da-b3e4-4055-8def-4c0df0af2b3a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:01.924547 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91086c-b0a1-4d6b-b2dc-eff2e5c39e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:01.925183 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91086c-b0a1-4d6b-b2dc-eff2e5c39e86 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:01.925465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91086c-b0a1-4d6b-b2dc-eff2e5c39e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:01.925742 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91086c-b0a1-4d6b-b2dc-eff2e5c39e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:01.934866 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91086c-b0a1-4d6b-b2dc-eff2e5c39e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:01.936490 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91086c-b0a1-4d6b-b2dc-eff2e5c39e86 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:01.946708 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1333/2661] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:18:02.285879 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5fa08-1a89-4367-b6ce-469caab01cac None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:02.295933 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5fa08-1a89-4367-b6ce-469caab01cac None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:02.300517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc705b-00fa-406d-93e4-46c74e8534ea tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b16630cb95c4e0fb1f2c689b4411214', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4108fee851444b7b4eed8343c214c0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:02.301170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc705b-00fa-406d-93e4-46c74e8534ea tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:02.301461 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc705b-00fa-406d-93e4-46c74e8534ea tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:02.301751 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc705b-00fa-406d-93e4-46c74e8534ea tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:02.302482 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc705b-00fa-406d-93e4-46c74e8534ea tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:18:02.302790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc705b-00fa-406d-93e4-46c74e8534ea tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:02.304490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc705b-00fa-406d-93e4-46c74e8534ea tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:02.316268 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1329/2662] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:18:02.320273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91086c-b0a1-4d6b-b2dc-eff2e5c39e86 service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:02.329546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91086c-b0a1-4d6b-b2dc-eff2e5c39e86 service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:02.334115 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce5e1-e0d2-4e85-8704-f05eedda7a68 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b16630cb95c4e0fb1f2c689b4411214', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4108fee851444b7b4eed8343c214c0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:02.334760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce5e1-e0d2-4e85-8704-f05eedda7a68 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:02.335046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce5e1-e0d2-4e85-8704-f05eedda7a68 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:02.335325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce5e1-e0d2-4e85-8704-f05eedda7a68 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:02.336037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce5e1-e0d2-4e85-8704-f05eedda7a68 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:02.337907 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce5e1-e0d2-4e85-8704-f05eedda7a68 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:02.363443 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1334/2663] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:18:02 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:02.367359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc705b-00fa-406d-93e4-46c74e8534ea tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:02.377309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc705b-00fa-406d-93e4-46c74e8534ea tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:02.432206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b16630cb95c4e0fb1f2c689b4411214', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4108fee851444b7b4eed8343c214c0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:02.432861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:02.433147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:02.433427 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:02.434143 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:18:02.434452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:02.436262 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:02.447202 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1330/2664] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:18:02.488948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce5e1-e0d2-4e85-8704-f05eedda7a68 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:02.499480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce5e1-e0d2-4e85-8704-f05eedda7a68 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:02.504374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b16630cb95c4e0fb1f2c689b4411214', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4108fee851444b7b4eed8343c214c0e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:02.505249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:02.505550 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:02.505843 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] PATH_INFO: `/v3/projects/44ca67e2855848e1bf138d690fbf6963` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:02.507091 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Authorizing `identity:delete_project(project_id=44ca67e2855848e1bf138d690fbf6963)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:02.509055 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:02.558811 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ca67e2855848e1bf138d690fbf6963', 'request_id': 'req-4addbd48-6176-40e2-a3fa-04519d06edc7'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:02.567400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ca67e2855848e1bf138d690fbf6963', 'request_id': 'req-4addbd48-6176-40e2-a3fa-04519d06edc7'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:02.573604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ca67e2855848e1bf138d690fbf6963', 'request_id': 'req-4addbd48-6176-40e2-a3fa-04519d06edc7'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:02.584350 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:02.592994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] The token cache is being invalidate because project 44ca67e2855848e1bf138d690fbf6963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:02.594694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:02.595584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-4addbd48-6176-40e2-a3fa-04519d06edc7 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:02.598326 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1335/2665] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:02 2022] DELETE /identity/v3/projects/44ca67e2855848e1bf138d690fbf6963 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:02.826326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:02.828702 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:02.905020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7953-b00f-4839-8ceb-582ed2a44142 tempest-VolumeQuotaClassesTest-1381116531 tempest-VolumeQuotaClassesTest-1381116531-project-admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:02.940170 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=100 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:02.974829 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:02.975717 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:02.976133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:02.976435 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] PATH_INFO: `/v3/users/ed496c8a2e2b4ebfba0f4acdbd5b26a6` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:02.984084 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed496c8a2e2b4ebfba0f4acdbd5b26a6)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:02.986477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:03.047120 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed496c8a2e2b4ebfba0f4acdbd5b26a6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.055745 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed496c8a2e2b4ebfba0f4acdbd5b26a6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.069096 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed496c8a2e2b4ebfba0f4acdbd5b26a6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.070276 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed496c8a2e2b4ebfba0f4acdbd5b26a6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.071267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed496c8a2e2b4ebfba0f4acdbd5b26a6'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.089839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1331/2666] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:18:02 2022] DELETE /identity/v3/users/ed496c8a2e2b4ebfba0f4acdbd5b26a6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:03.096658 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba42d1-1361-4be5-86f9-a8e2eaace6fe None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:03.097160 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba42d1-1361-4be5-86f9-a8e2eaace6fe None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:03.097589 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba42d1-1361-4be5-86f9-a8e2eaace6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:03.118048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-a1ba42d1-1361-4be5-86f9-a8e2eaace6fe None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:03.119271 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a1ba42d1-1361-4be5-86f9-a8e2eaace6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:03.192102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1336/2667] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:03.203775 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:03.205311 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:03.275045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935afbaa-fed8-4f66-83ea-d47500fb55e7 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:03.279432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d3ff1-e7fa-4566-9cec-dfa6cafa645d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:03.280138 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d3ff1-e7fa-4566-9cec-dfa6cafa645d service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:03.280445 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d3ff1-e7fa-4566-9cec-dfa6cafa645d service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:03.280729 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d3ff1-e7fa-4566-9cec-dfa6cafa645d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:03.291406 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d3ff1-e7fa-4566-9cec-dfa6cafa645d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:03.292898 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d3ff1-e7fa-4566-9cec-dfa6cafa645d service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:03.305294 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1332/2668] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:03.659466 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba42d1-1361-4be5-86f9-a8e2eaace6fe None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:03.661074 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a1ba42d1-1361-4be5-86f9-a8e2eaace6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:03.674821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba42d1-1361-4be5-86f9-a8e2eaace6fe None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:03.680456 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:03.681661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:03.682042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:03.682541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] PATH_INFO: `/v3/projects/82866e9c434843689ca8a1cbff26d52f` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:03.684298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82866e9c434843689ca8a1cbff26d52f)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:03.685918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:03.738485 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82866e9c434843689ca8a1cbff26d52f', 'request_id': 'req-e3d24df6-87c4-41b9-b9c2-b79577c15492'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.744694 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82866e9c434843689ca8a1cbff26d52f', 'request_id': 'req-e3d24df6-87c4-41b9-b9c2-b79577c15492'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.751325 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82866e9c434843689ca8a1cbff26d52f', 'request_id': 'req-e3d24df6-87c4-41b9-b9c2-b79577c15492'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.764892 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] The token cache is being invalidate because project 82866e9c434843689ca8a1cbff26d52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:03.765190 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.765807 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.767343 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1337/2669] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:03 2022] DELETE /identity/v3/projects/82866e9c434843689ca8a1cbff26d52f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:03.771401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d3ff1-e7fa-4566-9cec-dfa6cafa645d service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:03.783683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d3ff1-e7fa-4566-9cec-dfa6cafa645d service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:03.840968 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:03.852822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:03.854498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:03.855861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:03.856227 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] PATH_INFO: `/v3/users/4b16630cb95c4e0fb1f2c689b4411214` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:03.858416 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b16630cb95c4e0fb1f2c689b4411214)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:03.860930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:03.927840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b16630cb95c4e0fb1f2c689b4411214'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.939042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b16630cb95c4e0fb1f2c689b4411214'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.959306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b16630cb95c4e0fb1f2c689b4411214'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.960306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b16630cb95c4e0fb1f2c689b4411214'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.961278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b16630cb95c4e0fb1f2c689b4411214'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:03.981998 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1333/2670] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:18:03 2022] DELETE /identity/v3/users/4b16630cb95c4e0fb1f2c689b4411214 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:04.450746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:04.452860 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:04.531883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24df6-87c4-41b9-b9c2-b79577c15492 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:04.539160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:04.541159 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:04.579557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:04.602518 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb548d-d445-441b-b2cb-71eac997e6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:04.605022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb548d-d445-441b-b2cb-71eac997e6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:04.605494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb548d-d445-441b-b2cb-71eac997e6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:04.605946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb548d-d445-441b-b2cb-71eac997e6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:04.612997 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5fdb548d-d445-441b-b2cb-71eac997e6ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:04.629677 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb548d-d445-441b-b2cb-71eac997e6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:04.631877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb548d-d445-441b-b2cb-71eac997e6ca service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:04.642786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1338/2671] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:04.643811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61603e-0458-4e4f-add5-776050a796ed admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:04.648626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:04.649531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:04.650019 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:04.650422 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] PATH_INFO: `/v3/projects/f4108fee851444b7b4eed8343c214c0e` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:04.651679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4108fee851444b7b4eed8343c214c0e)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:04.654226 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:04.708988 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4108fee851444b7b4eed8343c214c0e', 'request_id': 'req-2c5f4223-a634-4ca2-8a72-8df09b4194df'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:04.717571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4108fee851444b7b4eed8343c214c0e', 'request_id': 'req-2c5f4223-a634-4ca2-8a72-8df09b4194df'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:04.725545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4108fee851444b7b4eed8343c214c0e', 'request_id': 'req-2c5f4223-a634-4ca2-8a72-8df09b4194df'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:04.740673 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] The token cache is being invalidate because project f4108fee851444b7b4eed8343c214c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:04.741061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:04.744376 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2c5f4223-a634-4ca2-8a72-8df09b4194df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:04.746172 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1334/2672] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:04 2022] DELETE /identity/v3/projects/f4108fee851444b7b4eed8343c214c0e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:04.752730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed9426-3421-4fcd-b690-4ede765be59f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:04.753235 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed9426-3421-4fcd-b690-4ede765be59f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:04.754532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed9426-3421-4fcd-b690-4ede765be59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:04.765330 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b85a7-6abe-4a88-8957-d87495049114 None None] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:04.765872 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b85a7-6abe-4a88-8957-d87495049114 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:04.766244 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b85a7-6abe-4a88-8957-d87495049114 None None] PATH_INFO: `/` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:04.767746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1335/2673] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:18:04.774260 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec918e64-8940-4ea9-834f-583004833a6f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:04.774672 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec918e64-8940-4ea9-834f-583004833a6f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:04.775044 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec918e64-8940-4ea9-834f-583004833a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:04.781962 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-84ed9426-3421-4fcd-b690-4ede765be59f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:04.782179 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:04.784446 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-84ed9426-3421-4fcd-b690-4ede765be59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:04.800425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-ec918e64-8940-4ea9-834f-583004833a6f None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:04.801790 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec918e64-8940-4ea9-834f-583004833a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:04.862841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1339/2674] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:04.871302 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad3323-247e-451f-84ec-22e27e9ec38c None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:04.871587 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad3323-247e-451f-84ec-22e27e9ec38c None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:04.872320 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad3323-247e-451f-84ec-22e27e9ec38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:04.882592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1336/2675] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:18:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:18:04.896973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3cad3323-247e-451f-84ec-22e27e9ec38c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:04.898205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3cad3323-247e-451f-84ec-22e27e9ec38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:04.902169 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec918e64-8940-4ea9-834f-583004833a6f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:04.903755 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-ec918e64-8940-4ea9-834f-583004833a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:04.907583 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1340/2676] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:18:04.911857 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad3323-247e-451f-84ec-22e27e9ec38c None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:04.922001 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad3323-247e-451f-84ec-22e27e9ec38c None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:04.927267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c439d-db63-4519-bc41-53d2def87347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:04.928031 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c439d-db63-4519-bc41-53d2def87347 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:04.928268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c439d-db63-4519-bc41-53d2def87347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:04.928552 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c439d-db63-4519-bc41-53d2def87347 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:04.929286 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c439d-db63-4519-bc41-53d2def87347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:18:04.929597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c439d-db63-4519-bc41-53d2def87347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:04.931195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c439d-db63-4519-bc41-53d2def87347 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:04.945126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1341/2677] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:18:04.949182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c439d-db63-4519-bc41-53d2def87347 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:04.961103 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c439d-db63-4519-bc41-53d2def87347 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:04.966535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec918e64-8940-4ea9-834f-583004833a6f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:04.967627 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ad641-5264-42cc-b12a-bb50163ee7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:04.968423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ad641-5264-42cc-b12a-bb50163ee7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:04.968778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ad641-5264-42cc-b12a-bb50163ee7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:04.969002 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ad641-5264-42cc-b12a-bb50163ee7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:04.969701 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ad641-5264-42cc-b12a-bb50163ee7c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:04.970428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab91f9d-5600-448a-9e89-3d1074000e0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7d9cfbbcd4068aa9241ffd694c631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:04.971076 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab91f9d-5600-448a-9e89-3d1074000e0b service glance] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:04.971361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab91f9d-5600-448a-9e89-3d1074000e0b service glance] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:04.971621 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ad641-5264-42cc-b12a-bb50163ee7c5 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:04.971746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab91f9d-5600-448a-9e89-3d1074000e0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:04.983594 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab91f9d-5600-448a-9e89-3d1074000e0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:04.985092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab91f9d-5600-448a-9e89-3d1074000e0b service glance] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.000272 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1337/2678] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:18:05.014253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1342/2679] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:18:04 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:18:05.018531 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab91f9d-5600-448a-9e89-3d1074000e0b service glance] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.030225 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab91f9d-5600-448a-9e89-3d1074000e0b service glance] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.071338 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab09290-d3a6-489b-956d-f4cd5bb0c10a None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.072248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab09290-d3a6-489b-956d-f4cd5bb0c10a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.072610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab09290-d3a6-489b-956d-f4cd5bb0c10a None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.074207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1343/2680] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:18:05.079178 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1743e-cba0-4d85-8202-1a2f919c9a5f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.079470 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1743e-cba0-4d85-8202-1a2f919c9a5f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.079753 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1743e-cba0-4d85-8202-1a2f919c9a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.097870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-45b1743e-cba0-4d85-8202-1a2f919c9a5f None None] MFA Rules not processed for user `fb227a145fdd44319f5ccbe762409ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:05.098848 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d5b9b-18f7-4177-96b3-90d719028ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.099239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-45b1743e-cba0-4d85-8202-1a2f919c9a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:05.099522 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d5b9b-18f7-4177-96b3-90d719028ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.099804 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d5b9b-18f7-4177-96b3-90d719028ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.100114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d5b9b-18f7-4177-96b3-90d719028ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.100797 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d5b9b-18f7-4177-96b3-90d719028ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.102733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d5b9b-18f7-4177-96b3-90d719028ef1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.127683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1338/2681] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:18:05 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:05.131711 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d5b9b-18f7-4177-96b3-90d719028ef1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.141638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d5b9b-18f7-4177-96b3-90d719028ef1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.146499 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ce99d-bebd-40e5-835e-08fd4c2f3655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.147236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ce99d-bebd-40e5-835e-08fd4c2f3655 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.147585 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ce99d-bebd-40e5-835e-08fd4c2f3655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.147966 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ce99d-bebd-40e5-835e-08fd4c2f3655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.148758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ce99d-bebd-40e5-835e-08fd4c2f3655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.150341 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ce99d-bebd-40e5-835e-08fd4c2f3655 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.159938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1344/2682] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:18:05.163923 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1339/2683] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:18:05.168015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1743e-cba0-4d85-8202-1a2f919c9a5f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.172486 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ce99d-bebd-40e5-835e-08fd4c2f3655 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.174267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-f82ce99d-bebd-40e5-835e-08fd4c2f3655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:05.180938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1743e-cba0-4d85-8202-1a2f919c9a5f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.185424 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610586e-3c48-4378-a31a-e874e09a7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.186102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610586e-3c48-4378-a31a-e874e09a7581 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.186386 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610586e-3c48-4378-a31a-e874e09a7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.186663 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610586e-3c48-4378-a31a-e874e09a7581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.187390 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610586e-3c48-4378-a31a-e874e09a7581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.189037 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610586e-3c48-4378-a31a-e874e09a7581 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.189174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ce99d-bebd-40e5-835e-08fd4c2f3655 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.192805 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb801d9-2fc4-4978-9198-4b17cf1aa6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.193456 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb801d9-2fc4-4978-9198-4b17cf1aa6db service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.193743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb801d9-2fc4-4978-9198-4b17cf1aa6db service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.194184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb801d9-2fc4-4978-9198-4b17cf1aa6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.199574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1345/2684] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:18:05.204102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610586e-3c48-4378-a31a-e874e09a7581 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.205243 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb801d9-2fc4-4978-9198-4b17cf1aa6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.206679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb801d9-2fc4-4978-9198-4b17cf1aa6db service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.213647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610586e-3c48-4378-a31a-e874e09a7581 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.214606 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1340/2685] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:18:05.220429 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4273724-363a-48be-8163-23f2672c64f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.221434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273724-363a-48be-8163-23f2672c64f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.221722 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273724-363a-48be-8163-23f2672c64f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.222000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273724-363a-48be-8163-23f2672c64f3 admin admin] PATH_INFO: `/v3/projects/7ccfcc4345104987aa9348cd47785133/users/2099e2cd82aa495ab73d033712b3940c/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.237988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4273724-363a-48be-8163-23f2672c64f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ccfcc4345104987aa9348cd47785133, user_id=2099e2cd82aa495ab73d033712b3940c, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.240691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4273724-363a-48be-8163-23f2672c64f3 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.255844 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1346/2686] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:05 2022] PUT /identity/v3/projects/7ccfcc4345104987aa9348cd47785133/users/2099e2cd82aa495ab73d033712b3940c/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:05.266284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e25b9-dd92-4ca4-a78d-07df44c8e03f None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.266700 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e25b9-dd92-4ca4-a78d-07df44c8e03f None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.267160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e25b9-dd92-4ca4-a78d-07df44c8e03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.273116 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:05.301186 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1212f-d43d-442c-9268-da299da9a0de None None] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.301480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1212f-d43d-442c-9268-da299da9a0de None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.301759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1212f-d43d-442c-9268-da299da9a0de None None] PATH_INFO: `/` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.303180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1347/2687] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 22:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 22:18:05.309369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e55b5-d4cf-4cb0-9865-060756134e6a None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.309660 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e55b5-d4cf-4cb0-9865-060756134e6a None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.310561 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e55b5-d4cf-4cb0-9865-060756134e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.311429 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-106e25b9-dd92-4ca4-a78d-07df44c8e03f None None] MFA Rules not processed for user `2099e2cd82aa495ab73d033712b3940c`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:05.312795 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-106e25b9-dd92-4ca4-a78d-07df44c8e03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:05.333441 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-c94e55b5-d4cf-4cb0-9865-060756134e6a None None] MFA Rules not processed for user `44e6d786ac4a40468794b18cfedfa730`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:05.335139 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c94e55b5-d4cf-4cb0-9865-060756134e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:05.346773 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:05.386640 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1341/2688] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:05.391489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e25b9-dd92-4ca4-a78d-07df44c8e03f None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.412323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1348/2689] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:18:05.424792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e55b5-d4cf-4cb0-9865-060756134e6a None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.426289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-c94e55b5-d4cf-4cb0-9865-060756134e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:05.475059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e25b9-dd92-4ca4-a78d-07df44c8e03f None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.486331 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b1a4d-24d0-40bd-ba41-fa8449010f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.488079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b1a4d-24d0-40bd-ba41-fa8449010f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.488413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b1a4d-24d0-40bd-ba41-fa8449010f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.489792 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b1a4d-24d0-40bd-ba41-fa8449010f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.492239 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b1a4d-24d0-40bd-ba41-fa8449010f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.494104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e55b5-d4cf-4cb0-9865-060756134e6a None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.495728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b1a4d-24d0-40bd-ba41-fa8449010f10 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.502738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fe34f-30e5-457a-aa2f-0afca3e256ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.504226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fe34f-30e5-457a-aa2f-0afca3e256ec service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.504526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fe34f-30e5-457a-aa2f-0afca3e256ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.504865 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fe34f-30e5-457a-aa2f-0afca3e256ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.523285 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fe34f-30e5-457a-aa2f-0afca3e256ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.525783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fe34f-30e5-457a-aa2f-0afca3e256ec service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.540955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1342/2691] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:18:05 2022] POST /identity/v3/projects => generated 399 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:05.544047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1349/2691] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:18:05.545457 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b1a4d-24d0-40bd-ba41-fa8449010f10 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.627601 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b1a4d-24d0-40bd-ba41-fa8449010f10 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.633058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd10a3-2e72-4877-9e37-a7a0fdd4c517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.633643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd10a3-2e72-4877-9e37-a7a0fdd4c517 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.648041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd10a3-2e72-4877-9e37-a7a0fdd4c517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.648489 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd10a3-2e72-4877-9e37-a7a0fdd4c517 admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.648736 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fe34f-30e5-457a-aa2f-0afca3e256ec service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.649379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd10a3-2e72-4877-9e37-a7a0fdd4c517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.650574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5d9fe34f-30e5-457a-aa2f-0afca3e256ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:05.651236 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd10a3-2e72-4877-9e37-a7a0fdd4c517 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.681079 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1343/2692] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:18:05 2022] POST /identity/v3/users => generated 306 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:18:05.682348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd10a3-2e72-4877-9e37-a7a0fdd4c517 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.705916 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd10a3-2e72-4877-9e37-a7a0fdd4c517 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.710863 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca977af9-75b1-49e6-8a3e-b2b1bd7c82d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.711540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca977af9-75b1-49e6-8a3e-b2b1bd7c82d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.711827 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca977af9-75b1-49e6-8a3e-b2b1bd7c82d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.712151 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca977af9-75b1-49e6-8a3e-b2b1bd7c82d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.712939 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca977af9-75b1-49e6-8a3e-b2b1bd7c82d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.714548 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca977af9-75b1-49e6-8a3e-b2b1bd7c82d9 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.716065 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:05.733731 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1344/2693] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:05.735323 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca977af9-75b1-49e6-8a3e-b2b1bd7c82d9 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.746155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca977af9-75b1-49e6-8a3e-b2b1bd7c82d9 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.747442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fe34f-30e5-457a-aa2f-0afca3e256ec service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.751573 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce239ec-bf3e-4d70-b7c2-9e3f07ddcce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.752533 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce239ec-bf3e-4d70-b7c2-9e3f07ddcce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.752820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce239ec-bf3e-4d70-b7c2-9e3f07ddcce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.753100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce239ec-bf3e-4d70-b7c2-9e3f07ddcce6 admin admin] PATH_INFO: `/v3/projects/b6dbf18a084a42fabfd44f09a9194002/users/a0da686b134b4f3ca4b4c795032a7bb0/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.771631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce239ec-bf3e-4d70-b7c2-9e3f07ddcce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dbf18a084a42fabfd44f09a9194002, user_id=a0da686b134b4f3ca4b4c795032a7bb0, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.774306 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce239ec-bf3e-4d70-b7c2-9e3f07ddcce6 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.791839 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1345/2694] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:05 2022] PUT /identity/v3/projects/b6dbf18a084a42fabfd44f09a9194002/users/a0da686b134b4f3ca4b4c795032a7bb0/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:05.796949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce239ec-bf3e-4d70-b7c2-9e3f07ddcce6 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.809087 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=100 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:05.827126 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf25a96-43e2-4c3d-a1d2-05ede8ea3e73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.827977 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf25a96-43e2-4c3d-a1d2-05ede8ea3e73 service placement] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.828313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf25a96-43e2-4c3d-a1d2-05ede8ea3e73 service placement] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.828623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf25a96-43e2-4c3d-a1d2-05ede8ea3e73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.830798 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8bf25a96-43e2-4c3d-a1d2-05ede8ea3e73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:05.844691 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf25a96-43e2-4c3d-a1d2-05ede8ea3e73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.846339 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf25a96-43e2-4c3d-a1d2-05ede8ea3e73 service placement] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.857430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1350/2695] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:18:05.874431 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce239ec-bf3e-4d70-b7c2-9e3f07ddcce6 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.878984 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c14278-4a6f-464a-b467-111c0454ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.879657 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14278-4a6f-464a-b467-111c0454ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.880001 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14278-4a6f-464a-b467-111c0454ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.880321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14278-4a6f-464a-b467-111c0454ebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.881053 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c14278-4a6f-464a-b467-111c0454ebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.882944 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c14278-4a6f-464a-b467-111c0454ebd2 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.898660 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1346/2696] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:18:05.899948 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf25a96-43e2-4c3d-a1d2-05ede8ea3e73 service placement] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:05.910830 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf25a96-43e2-4c3d-a1d2-05ede8ea3e73 service placement] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:05.915867 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dcc87-a67a-4ceb-bb7e-8168a2e3ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:05.916845 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dcc87-a67a-4ceb-bb7e-8168a2e3ceab admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.917193 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dcc87-a67a-4ceb-bb7e-8168a2e3ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.917534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dcc87-a67a-4ceb-bb7e-8168a2e3ceab admin admin] PATH_INFO: `/v3/projects/b6dbf18a084a42fabfd44f09a9194002/users/a0da686b134b4f3ca4b4c795032a7bb0/roles/27c150d4011b475d8e4ee5726c96a03c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.919620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dcc87-a67a-4ceb-bb7e-8168a2e3ceab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dbf18a084a42fabfd44f09a9194002, user_id=a0da686b134b4f3ca4b4c795032a7bb0, role_id=27c150d4011b475d8e4ee5726c96a03c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:05.922578 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dcc87-a67a-4ceb-bb7e-8168a2e3ceab admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:05.935457 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1351/2697] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:05 2022] PUT /identity/v3/projects/b6dbf18a084a42fabfd44f09a9194002/users/a0da686b134b4f3ca4b4c795032a7bb0/roles/27c150d4011b475d8e4ee5726c96a03c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:05.947044 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9ef56-2404-42fb-8ec0-c69b99a08ae7 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:05.947228 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9ef56-2404-42fb-8ec0-c69b99a08ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:05.947670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9ef56-2404-42fb-8ec0-c69b99a08ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:05.981092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1db9ef56-2404-42fb-8ec0-c69b99a08ae7 None None] MFA Rules not processed for user `a0da686b134b4f3ca4b4c795032a7bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:05.982608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1db9ef56-2404-42fb-8ec0-c69b99a08ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:06.076926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1347/2698] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:06.086527 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dcc87-a67a-4ceb-bb7e-8168a2e3ceab admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:06.088824 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-092dcc87-a67a-4ceb-bb7e-8168a2e3ceab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:06.178996 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dcc87-a67a-4ceb-bb7e-8168a2e3ceab admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:06.183064 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f8b5-290f-4773-8b07-0bd22078a413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:06.183723 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f8b5-290f-4773-8b07-0bd22078a413 service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:06.184028 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f8b5-290f-4773-8b07-0bd22078a413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:06.184304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f8b5-290f-4773-8b07-0bd22078a413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:06.195503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39f8b5-290f-4773-8b07-0bd22078a413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:06.197426 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39f8b5-290f-4773-8b07-0bd22078a413 service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:06.211124 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1352/2699] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:06 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:06.290168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9ef56-2404-42fb-8ec0-c69b99a08ae7 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:06.310638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9ef56-2404-42fb-8ec0-c69b99a08ae7 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:06.314385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfedb88-91ad-4d9e-8044-d61025f81325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:06.315069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfedb88-91ad-4d9e-8044-d61025f81325 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:06.316081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfedb88-91ad-4d9e-8044-d61025f81325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:06.316081 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfedb88-91ad-4d9e-8044-d61025f81325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:06.377168 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:06.389034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfedb88-91ad-4d9e-8044-d61025f81325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:06.391011 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfedb88-91ad-4d9e-8044-d61025f81325 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:06.401663 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1348/2700] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:09.019127 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a58ac0-0c37-47da-a9d8-7ff99464b323 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:09.019604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a58ac0-0c37-47da-a9d8-7ff99464b323 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:09.019721 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a58ac0-0c37-47da-a9d8-7ff99464b323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:09.039007 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-76a58ac0-0c37-47da-a9d8-7ff99464b323 None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:09.040234 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-76a58ac0-0c37-47da-a9d8-7ff99464b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:09.097778 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1353/2701] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 22:18:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:09.121082 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfedb88-91ad-4d9e-8044-d61025f81325 service cinder] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:09.122492 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4dfedb88-91ad-4d9e-8044-d61025f81325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:09.227789 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfedb88-91ad-4d9e-8044-d61025f81325 service cinder] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:09.234334 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805472ea-f547-404c-b1e6-e2c60490b085 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:09.235108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805472ea-f547-404c-b1e6-e2c60490b085 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:09.235426 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805472ea-f547-404c-b1e6-e2c60490b085 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:09.235706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805472ea-f547-404c-b1e6-e2c60490b085 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:09.246040 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805472ea-f547-404c-b1e6-e2c60490b085 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:09.249265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805472ea-f547-404c-b1e6-e2c60490b085 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:09.257485 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1349/2702] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:18:10.622640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a58ac0-0c37-47da-a9d8-7ff99464b323 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:10.707257 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a58ac0-0c37-47da-a9d8-7ff99464b323 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:10.711969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:10.712855 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:10.713135 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:10.713439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] PATH_INFO: `/v3/users/2099e2cd82aa495ab73d033712b3940c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:10.714620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2099e2cd82aa495ab73d033712b3940c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:10.718438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:10.741195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:10.798546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2099e2cd82aa495ab73d033712b3940c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:10.811541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2099e2cd82aa495ab73d033712b3940c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:10.812400 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2099e2cd82aa495ab73d033712b3940c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:10.851158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2099e2cd82aa495ab73d033712b3940c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:10.852016 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2099e2cd82aa495ab73d033712b3940c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:10.888434 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1354/2703] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:18:10 2022] DELETE /identity/v3/users/2099e2cd82aa495ab73d033712b3940c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:10.890442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea241b-a596-4c97-be36-d7931984b2c0 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:10.891254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea241b-a596-4c97-be36-d7931984b2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:10.891703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea241b-a596-4c97-be36-d7931984b2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:10.916163 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c4ea241b-a596-4c97-be36-d7931984b2c0 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:10.917613 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c4ea241b-a596-4c97-be36-d7931984b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:11.016067 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1350/2704] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:11.026636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:11.026842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:11.134212 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b30ab-6e5c-4a78-aba4-7f5631da30df admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:11.140387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c8220-9242-409b-b6a5-bf15ba972fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:11.141199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c8220-9242-409b-b6a5-bf15ba972fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:11.141564 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c8220-9242-409b-b6a5-bf15ba972fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:11.141848 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c8220-9242-409b-b6a5-bf15ba972fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:11.153452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c8220-9242-409b-b6a5-bf15ba972fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:11.156237 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c8220-9242-409b-b6a5-bf15ba972fb4 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:11.184292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1355/2705] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:11.473596 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea241b-a596-4c97-be36-d7931984b2c0 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:11.475283 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c4ea241b-a596-4c97-be36-d7931984b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:11.500098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea241b-a596-4c97-be36-d7931984b2c0 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:11.505680 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:11.506798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:11.507208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:11.507739 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] PATH_INFO: `/v3/projects/7ccfcc4345104987aa9348cd47785133` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:11.509133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ccfcc4345104987aa9348cd47785133)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:11.511264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:11.518695 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c8220-9242-409b-b6a5-bf15ba972fb4 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:11.520175 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-a16c8220-9242-409b-b6a5-bf15ba972fb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:11.538764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c8220-9242-409b-b6a5-bf15ba972fb4 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:11.544123 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:11.545323 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:11.545918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:11.546117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] PATH_INFO: `/v3/users/5cd43cd88bb74af880f060249ad8d142` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:11.547651 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd43cd88bb74af880f060249ad8d142)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:11.550777 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:11.590048 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ccfcc4345104987aa9348cd47785133', 'request_id': 'req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.600754 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ccfcc4345104987aa9348cd47785133', 'request_id': 'req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.620581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ccfcc4345104987aa9348cd47785133', 'request_id': 'req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.632158 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd43cd88bb74af880f060249ad8d142'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.644224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] The token cache is being invalidate because project 7ccfcc4345104987aa9348cd47785133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:11.644704 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.645464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.647292 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1351/2706] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:11 2022] DELETE /identity/v3/projects/7ccfcc4345104987aa9348cd47785133 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:11.652229 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd43cd88bb74af880f060249ad8d142'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.653165 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd43cd88bb74af880f060249ad8d142'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.653384 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:11.659303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:11.669622 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:11.673966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd43cd88bb74af880f060249ad8d142'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.674982 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-6479ffee-8721-4ddd-b8be-7f1ad518a34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd43cd88bb74af880f060249ad8d142'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:11.703813 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1356/2707] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:18:11 2022] DELETE /identity/v3/users/5cd43cd88bb74af880f060249ad8d142 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:11.705602 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae3694-64b9-4be7-a6b9-b07636010e25 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:11.706005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae3694-64b9-4be7-a6b9-b07636010e25 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:11.706298 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae3694-64b9-4be7-a6b9-b07636010e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:11.728322 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-72ae3694-64b9-4be7-a6b9-b07636010e25 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:11.738356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-72ae3694-64b9-4be7-a6b9-b07636010e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:11.743423 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:11.772042 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa4924-0d9c-4bfc-b7ea-f3f0450c552a admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:11.809304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1357/2708] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:11.819883 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae3694-64b9-4be7-a6b9-b07636010e25 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:11.821494 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-72ae3694-64b9-4be7-a6b9-b07636010e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:11.886393 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:11.887443 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:11.888010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:11.889045 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] PATH_INFO: `/v3/users/a0da686b134b4f3ca4b4c795032a7bb0` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:11.890904 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0da686b134b4f3ca4b4c795032a7bb0)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:11.893031 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:11.909475 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae3694-64b9-4be7-a6b9-b07636010e25 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:11.913332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f26c-8761-4e97-8ad3-ccf3fe16ce58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:11.913994 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f26c-8761-4e97-8ad3-ccf3fe16ce58 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:11.914333 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f26c-8761-4e97-8ad3-ccf3fe16ce58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:11.914557 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f26c-8761-4e97-8ad3-ccf3fe16ce58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:11.953857 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177f26c-8761-4e97-8ad3-ccf3fe16ce58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:11.955661 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177f26c-8761-4e97-8ad3-ccf3fe16ce58 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:11.984584 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1358/2709] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:18:11.992094 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0da686b134b4f3ca4b4c795032a7bb0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.014671 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0da686b134b4f3ca4b4c795032a7bb0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.030590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0da686b134b4f3ca4b4c795032a7bb0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.031388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0da686b134b4f3ca4b4c795032a7bb0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.032072 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0da686b134b4f3ca4b4c795032a7bb0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.053199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1352/2710] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:18:11 2022] DELETE /identity/v3/users/a0da686b134b4f3ca4b4c795032a7bb0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:12.599935 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f26c-8761-4e97-8ad3-ccf3fe16ce58 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:12.601556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-b177f26c-8761-4e97-8ad3-ccf3fe16ce58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:12.610805 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:12.612465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:12.633628 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f26c-8761-4e97-8ad3-ccf3fe16ce58 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:12.710524 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:12.744348 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:12.745410 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:12.745700 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:12.745980 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] PATH_INFO: `/v3/projects/38fdbf4a463545ecb37b4184b5db764d` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:12.750581 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fdbf4a463545ecb37b4184b5db764d)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:12.757551 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74948eb-2477-418a-b226-0a8aae1720a1 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:12.758704 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:12.771562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:12.773411 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:12.773957 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:12.774459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] PATH_INFO: `/v3/projects/b6dbf18a084a42fabfd44f09a9194002` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:12.776811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6dbf18a084a42fabfd44f09a9194002)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:12.780981 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:12.855968 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fdbf4a463545ecb37b4184b5db764d', 'request_id': 'req-8243f7c4-6e97-481b-a692-90aef2c3ec60'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.865333 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6dbf18a084a42fabfd44f09a9194002', 'request_id': 'req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.871659 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fdbf4a463545ecb37b4184b5db764d', 'request_id': 'req-8243f7c4-6e97-481b-a692-90aef2c3ec60'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.876506 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:12.881508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6dbf18a084a42fabfd44f09a9194002', 'request_id': 'req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.887054 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fdbf4a463545ecb37b4184b5db764d', 'request_id': 'req-8243f7c4-6e97-481b-a692-90aef2c3ec60'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.899373 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6dbf18a084a42fabfd44f09a9194002', 'request_id': 'req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.910857 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] The token cache is being invalidate because project 38fdbf4a463545ecb37b4184b5db764d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:12.911510 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.912577 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-8243f7c4-6e97-481b-a692-90aef2c3ec60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.918033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1359/2711] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:12 2022] DELETE /identity/v3/projects/38fdbf4a463545ecb37b4184b5db764d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:12.920690 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5588660-24d4-4bf2-8c52-d6b0c82d29fb None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:12.921873 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5588660-24d4-4bf2-8c52-d6b0c82d29fb None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:12.922256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5588660-24d4-4bf2-8c52-d6b0c82d29fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:12.925471 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] The token cache is being invalidate because project b6dbf18a084a42fabfd44f09a9194002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:12.928714 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.930290 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-2099ecdd-8e22-4c95-bde0-2834bc6efbf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:12.935949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1353/2712] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:12 2022] DELETE /identity/v3/projects/b6dbf18a084a42fabfd44f09a9194002 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:12.942425 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded1f5c-4bd6-43d8-94cd-37e4708f1bbd None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:12.943263 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded1f5c-4bd6-43d8-94cd-37e4708f1bbd None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:12.943927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded1f5c-4bd6-43d8-94cd-37e4708f1bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:12.953697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f5588660-24d4-4bf2-8c52-d6b0c82d29fb None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:12.955089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f5588660-24d4-4bf2-8c52-d6b0c82d29fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:12.988338 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-1ded1f5c-4bd6-43d8-94cd-37e4708f1bbd None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:12.989728 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1ded1f5c-4bd6-43d8-94cd-37e4708f1bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:13.036711 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1360/2713] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:13.045239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8062db3-e323-4f5c-9579-5b9795c23b03 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.045613 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8062db3-e323-4f5c-9579-5b9795c23b03 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.046012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8062db3-e323-4f5c-9579-5b9795c23b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.082460 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1354/2714] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:13.089495 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d8062db3-e323-4f5c-9579-5b9795c23b03 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:13.090631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f89fe1-3200-45c3-903a-7e3b153c05f8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.090762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d8062db3-e323-4f5c-9579-5b9795c23b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:13.091123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f89fe1-3200-45c3-903a-7e3b153c05f8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.092191 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f89fe1-3200-45c3-903a-7e3b153c05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.113332 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1361/2715] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:13.117567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8062db3-e323-4f5c-9579-5b9795c23b03 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.133885 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-c1f89fe1-3200-45c3-903a-7e3b153c05f8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:13.135292 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8062db3-e323-4f5c-9579-5b9795c23b03 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.135517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-c1f89fe1-3200-45c3-903a-7e3b153c05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:13.141303 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060d4b-a5df-4458-9ce9-36cbfd0b7416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.142202 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060d4b-a5df-4458-9ce9-36cbfd0b7416 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.142672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060d4b-a5df-4458-9ce9-36cbfd0b7416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.143107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060d4b-a5df-4458-9ce9-36cbfd0b7416 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.144219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3060d4b-a5df-4458-9ce9-36cbfd0b7416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:18:13.144687 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3060d4b-a5df-4458-9ce9-36cbfd0b7416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.147070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1355/2716] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:13.148783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3060d4b-a5df-4458-9ce9-36cbfd0b7416 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.151388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f89fe1-3200-45c3-903a-7e3b153c05f8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.162339 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f89fe1-3200-45c3-903a-7e3b153c05f8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.167625 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb531fb4-cb0c-4b05-a672-d8ab1e5b2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.168464 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531fb4-cb0c-4b05-a672-d8ab1e5b2a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.168856 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531fb4-cb0c-4b05-a672-d8ab1e5b2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.169638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531fb4-cb0c-4b05-a672-d8ab1e5b2a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.170832 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb531fb4-cb0c-4b05-a672-d8ab1e5b2a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:18:13.172126 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb531fb4-cb0c-4b05-a672-d8ab1e5b2a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.174039 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb531fb4-cb0c-4b05-a672-d8ab1e5b2a4d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.192462 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1356/2717] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:18:13.196564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb531fb4-cb0c-4b05-a672-d8ab1e5b2a4d admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.202248 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1362/2718] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:18:13.203438 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060d4b-a5df-4458-9ce9-36cbfd0b7416 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.213208 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb531fb4-cb0c-4b05-a672-d8ab1e5b2a4d admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.219940 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d91cf-820b-4bfa-a820-c6bfc210f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.221100 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d91cf-820b-4bfa-a820-c6bfc210f292 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.221661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d91cf-820b-4bfa-a820-c6bfc210f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.221792 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060d4b-a5df-4458-9ce9-36cbfd0b7416 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.222346 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d91cf-820b-4bfa-a820-c6bfc210f292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.224007 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d91cf-820b-4bfa-a820-c6bfc210f292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.226329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d91cf-820b-4bfa-a820-c6bfc210f292 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.237273 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc6af7-25cf-42e7-b26b-128e0c9c427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.238511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc6af7-25cf-42e7-b26b-128e0c9c427c admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.238804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc6af7-25cf-42e7-b26b-128e0c9c427c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.239083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc6af7-25cf-42e7-b26b-128e0c9c427c admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.239783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc6af7-25cf-42e7-b26b-128e0c9c427c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.243291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc6af7-25cf-42e7-b26b-128e0c9c427c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.262661 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1357/2719] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:18:13 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:18:13.267445 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d91cf-820b-4bfa-a820-c6bfc210f292 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.287496 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1363/2720] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:18:13 2022] POST /identity/v3/projects => generated 363 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:13.288759 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc6af7-25cf-42e7-b26b-128e0c9c427c admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.328630 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:13.423931 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d91cf-820b-4bfa-a820-c6bfc210f292 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.448238 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc6af7-25cf-42e7-b26b-128e0c9c427c admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.457738 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862cf02-01e7-4bbe-83d2-a7a7be6199f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.458581 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862cf02-01e7-4bbe-83d2-a7a7be6199f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.458874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862cf02-01e7-4bbe-83d2-a7a7be6199f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.459197 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862cf02-01e7-4bbe-83d2-a7a7be6199f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.460259 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862cf02-01e7-4bbe-83d2-a7a7be6199f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.462147 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862cf02-01e7-4bbe-83d2-a7a7be6199f8 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.488044 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1364/2721] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:18:13 2022] POST /identity/v3/users => generated 282 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:13.492095 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862cf02-01e7-4bbe-83d2-a7a7be6199f8 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.503289 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862cf02-01e7-4bbe-83d2-a7a7be6199f8 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.509085 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b372c-69d3-4234-b518-a6fda90c09ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.509975 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b372c-69d3-4234-b518-a6fda90c09ec admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.510291 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b372c-69d3-4234-b518-a6fda90c09ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.510739 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b372c-69d3-4234-b518-a6fda90c09ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.511459 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b372c-69d3-4234-b518-a6fda90c09ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.513261 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b372c-69d3-4234-b518-a6fda90c09ec admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.529828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fa258-8a7c-4c5d-9d28-d204e5fabd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.530539 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fa258-8a7c-4c5d-9d28-d204e5fabd2e admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.531018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fa258-8a7c-4c5d-9d28-d204e5fabd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.531295 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fa258-8a7c-4c5d-9d28-d204e5fabd2e admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.532319 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fa258-8a7c-4c5d-9d28-d204e5fabd2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.533374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1365/2722] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:18:13.534288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b372c-69d3-4234-b518-a6fda90c09ec admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.534491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fa258-8a7c-4c5d-9d28-d204e5fabd2e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.547056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b372c-69d3-4234-b518-a6fda90c09ec admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.561710 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a8ca6-19c2-44a1-a5e6-1cec46fa4d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.562502 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a8ca6-19c2-44a1-a5e6-1cec46fa4d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.562786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a8ca6-19c2-44a1-a5e6-1cec46fa4d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.563066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a8ca6-19c2-44a1-a5e6-1cec46fa4d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.563783 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a8ca6-19c2-44a1-a5e6-1cec46fa4d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.566278 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a8ca6-19c2-44a1-a5e6-1cec46fa4d77 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.570293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1358/2723] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:18:13 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:13.575784 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fa258-8a7c-4c5d-9d28-d204e5fabd2e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.581764 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1366/2724] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:13.583182 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a8ca6-19c2-44a1-a5e6-1cec46fa4d77 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.587626 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fa258-8a7c-4c5d-9d28-d204e5fabd2e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.593593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674942c-03d6-4a68-8c81-88c9681b7b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.594608 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674942c-03d6-4a68-8c81-88c9681b7b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.594907 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674942c-03d6-4a68-8c81-88c9681b7b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.595284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674942c-03d6-4a68-8c81-88c9681b7b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.596097 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674942c-03d6-4a68-8c81-88c9681b7b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.598336 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674942c-03d6-4a68-8c81-88c9681b7b10 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.603015 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a8ca6-19c2-44a1-a5e6-1cec46fa4d77 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.610130 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1359/2725] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:13.613420 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b787e0c-9982-4e5f-943e-971a22f6c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.614356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b787e0c-9982-4e5f-943e-971a22f6c59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.614786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b787e0c-9982-4e5f-943e-971a22f6c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.615077 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b787e0c-9982-4e5f-943e-971a22f6c59a admin admin] PATH_INFO: `/v3/projects/6c7872ccb2544b3880b5f8e8d6ea44b9/users/ac52afa4afcc4e69b51744f3555f7f22/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.617246 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674942c-03d6-4a68-8c81-88c9681b7b10 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.618894 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:13.632015 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674942c-03d6-4a68-8c81-88c9681b7b10 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.637955 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1890e-82fb-46c9-b882-7edd6f212d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.638764 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1890e-82fb-46c9-b882-7edd6f212d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.639059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1890e-82fb-46c9-b882-7edd6f212d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.639366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1890e-82fb-46c9-b882-7edd6f212d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.640491 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1890e-82fb-46c9-b882-7edd6f212d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.642505 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1890e-82fb-46c9-b882-7edd6f212d91 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.653042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b787e0c-9982-4e5f-943e-971a22f6c59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7872ccb2544b3880b5f8e8d6ea44b9, user_id=ac52afa4afcc4e69b51744f3555f7f22, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.657712 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b787e0c-9982-4e5f-943e-971a22f6c59a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.666900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1360/2726] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:13.669052 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1890e-82fb-46c9-b882-7edd6f212d91 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.674504 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1367/2727] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:13 2022] PUT /identity/v3/projects/6c7872ccb2544b3880b5f8e8d6ea44b9/users/ac52afa4afcc4e69b51744f3555f7f22/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:13.684300 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1890e-82fb-46c9-b882-7edd6f212d91 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:13.685164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096a586-48db-4840-a814-97b7d87d9066 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.686522 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096a586-48db-4840-a814-97b7d87d9066 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.686884 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096a586-48db-4840-a814-97b7d87d9066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.722306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-d096a586-48db-4840-a814-97b7d87d9066 None None] MFA Rules not processed for user `ac52afa4afcc4e69b51744f3555f7f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:13.727818 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d096a586-48db-4840-a814-97b7d87d9066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:13.807581 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec2403-4726-4b00-be26-a23f1bf69793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:13.808862 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec2403-4726-4b00-be26-a23f1bf69793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.809205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec2403-4726-4b00-be26-a23f1bf69793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.809685 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec2403-4726-4b00-be26-a23f1bf69793 admin admin] PATH_INFO: `/v3/projects/ce6d0074ddec41fb825bd4ad42fcbde0/users/0913a572bb854d05a312b0f0c42b32d0/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.838275 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1368/2728] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:13.844805 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec2403-4726-4b00-be26-a23f1bf69793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6d0074ddec41fb825bd4ad42fcbde0, user_id=0913a572bb854d05a312b0f0c42b32d0, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:13.849122 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec2403-4726-4b00-be26-a23f1bf69793 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:13.855744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096a586-48db-4840-a814-97b7d87d9066 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:13.858414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d096a586-48db-4840-a814-97b7d87d9066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:13.870840 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1361/2729] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:13 2022] PUT /identity/v3/projects/ce6d0074ddec41fb825bd4ad42fcbde0/users/0913a572bb854d05a312b0f0c42b32d0/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:13.897222 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd54f89-36ef-4a32-98fa-dcd95d34b43b None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:13.897627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd54f89-36ef-4a32-98fa-dcd95d34b43b None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:13.897912 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd54f89-36ef-4a32-98fa-dcd95d34b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:13.934248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-9bd54f89-36ef-4a32-98fa-dcd95d34b43b None None] MFA Rules not processed for user `0913a572bb854d05a312b0f0c42b32d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:13.936496 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9bd54f89-36ef-4a32-98fa-dcd95d34b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:13.942930 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:13.969890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096a586-48db-4840-a814-97b7d87d9066 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:14.034440 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07f67-a000-425d-af20-1fe96ab0d26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:14.035117 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07f67-a000-425d-af20-1fe96ab0d26d service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:14.035394 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07f67-a000-425d-af20-1fe96ab0d26d service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:14.035676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07f67-a000-425d-af20-1fe96ab0d26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:14.050413 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1362/2730] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:18:14.066258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd54f89-36ef-4a32-98fa-dcd95d34b43b None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:14.066258 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-9bd54f89-36ef-4a32-98fa-dcd95d34b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:14.078230 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd54f89-36ef-4a32-98fa-dcd95d34b43b None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:14.088475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b86597-0d31-418f-b8ce-e134ee4881b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:14.090221 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:14.090369 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b86597-0d31-418f-b8ce-e134ee4881b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:14.090607 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b86597-0d31-418f-b8ce-e134ee4881b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:14.091144 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b86597-0d31-418f-b8ce-e134ee4881b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:14.112330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed07f67-a000-425d-af20-1fe96ab0d26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:14.113785 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed07f67-a000-425d-af20-1fe96ab0d26d service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:14.115328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b86597-0d31-418f-b8ce-e134ee4881b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:14.117017 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b86597-0d31-418f-b8ce-e134ee4881b3 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:14.127249 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1369/2731] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:14.140068 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1363/2732] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:18:14.152065 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07f67-a000-425d-af20-1fe96ab0d26d service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:14.249022 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07f67-a000-425d-af20-1fe96ab0d26d service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:14.253827 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:14.254707 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:14.254988 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:14.255267 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] PATH_INFO: `/v3/users/0913a572bb854d05a312b0f0c42b32d0` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:14.256503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0913a572bb854d05a312b0f0c42b32d0)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:14.266371 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:14.359020 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0913a572bb854d05a312b0f0c42b32d0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:14.369841 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0913a572bb854d05a312b0f0c42b32d0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:14.370611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0913a572bb854d05a312b0f0c42b32d0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:14.397330 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0913a572bb854d05a312b0f0c42b32d0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:14.397945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0913a572bb854d05a312b0f0c42b32d0'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:14.413311 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1370/2733] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:18:14 2022] DELETE /identity/v3/users/0913a572bb854d05a312b0f0c42b32d0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:14.419743 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17f735-2cd0-4c7f-b199-d8ba2f77ce2c None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:14.420362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17f735-2cd0-4c7f-b199-d8ba2f77ce2c None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:14.420846 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17f735-2cd0-4c7f-b199-d8ba2f77ce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:14.449020 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-8c17f735-2cd0-4c7f-b199-d8ba2f77ce2c None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:14.453868 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8c17f735-2cd0-4c7f-b199-d8ba2f77ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:14.596718 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1364/2734] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:18:14.608553 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:14.610272 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:14.708349 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41cc21-8710-4efe-97b2-859674bc8f73 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:14.715419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218545e-b446-48ad-b5ad-a2d2c07e25fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:14.717963 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218545e-b446-48ad-b5ad-a2d2c07e25fe service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:14.729594 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218545e-b446-48ad-b5ad-a2d2c07e25fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:14.730871 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218545e-b446-48ad-b5ad-a2d2c07e25fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:14.755101 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218545e-b446-48ad-b5ad-a2d2c07e25fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:14.757430 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218545e-b446-48ad-b5ad-a2d2c07e25fe service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:14.780083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1371/2735] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:15.146983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17f735-2cd0-4c7f-b199-d8ba2f77ce2c None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:15.148970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-8c17f735-2cd0-4c7f-b199-d8ba2f77ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:15.164018 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17f735-2cd0-4c7f-b199-d8ba2f77ce2c None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:15.169407 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:15.171632 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.171892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.172490 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] PATH_INFO: `/v3/projects/ce6d0074ddec41fb825bd4ad42fcbde0` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.173924 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6d0074ddec41fb825bd4ad42fcbde0)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:15.176432 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:15.254452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6d0074ddec41fb825bd4ad42fcbde0', 'request_id': 'req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:15.261134 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6d0074ddec41fb825bd4ad42fcbde0', 'request_id': 'req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:15.271199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6d0074ddec41fb825bd4ad42fcbde0', 'request_id': 'req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:15.290005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] The token cache is being invalidate because project ce6d0074ddec41fb825bd4ad42fcbde0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:15.290395 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:15.291206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7bd9d8b9-f86e-4c86-b964-415f8c5602fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:15.292788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1365/2736] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:15 2022] DELETE /identity/v3/projects/ce6d0074ddec41fb825bd4ad42fcbde0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:15.298310 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d8547-1433-46e0-983f-2b5dd0c44a49 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.298597 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d8547-1433-46e0-983f-2b5dd0c44a49 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.298874 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d8547-1433-46e0-983f-2b5dd0c44a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.311840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:15.319268 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-7b1d8547-1433-46e0-983f-2b5dd0c44a49 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:15.321355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-7b1d8547-1433-46e0-983f-2b5dd0c44a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:15.400000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1372/2737] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:15.409508 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56ad5b-eb7a-4837-9d5e-5adf99b8adb8 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.409880 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56ad5b-eb7a-4837-9d5e-5adf99b8adb8 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.410245 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56ad5b-eb7a-4837-9d5e-5adf99b8adb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.429703 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5f56ad5b-eb7a-4837-9d5e-5adf99b8adb8 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:15.431037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5f56ad5b-eb7a-4837-9d5e-5adf99b8adb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:15.439620 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1366/2738] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:15.444377 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d8547-1433-46e0-983f-2b5dd0c44a49 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:15.457288 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d8547-1433-46e0-983f-2b5dd0c44a49 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:15.462004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ee36d-d7b0-415d-a0a1-c32347418c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:15.462676 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ee36d-d7b0-415d-a0a1-c32347418c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.462960 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ee36d-d7b0-415d-a0a1-c32347418c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.463239 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ee36d-d7b0-415d-a0a1-c32347418c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.464012 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ee36d-d7b0-415d-a0a1-c32347418c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:18:15.464316 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ee36d-d7b0-415d-a0a1-c32347418c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:15.465916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ee36d-d7b0-415d-a0a1-c32347418c32 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:15.483528 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56ad5b-eb7a-4837-9d5e-5adf99b8adb8 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:15.486611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1373/2739] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:18:15.493592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56ad5b-eb7a-4837-9d5e-5adf99b8adb8 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:15.498321 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf73e5-bcae-4e59-b86e-ee34edef18db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:15.499174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf73e5-bcae-4e59-b86e-ee34edef18db admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.499463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf73e5-bcae-4e59-b86e-ee34edef18db admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.499741 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf73e5-bcae-4e59-b86e-ee34edef18db admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.500493 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf73e5-bcae-4e59-b86e-ee34edef18db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:15.502410 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf73e5-bcae-4e59-b86e-ee34edef18db admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:15.511685 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:15.536135 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1367/2740] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:18:15 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:18:15.540260 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ee36d-d7b0-415d-a0a1-c32347418c32 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:15.551324 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ee36d-d7b0-415d-a0a1-c32347418c32 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:15.615219 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67812ee-f1bd-4ed8-91dd-52da90715afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:15.615918 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67812ee-f1bd-4ed8-91dd-52da90715afb admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.616230 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67812ee-f1bd-4ed8-91dd-52da90715afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.616513 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67812ee-f1bd-4ed8-91dd-52da90715afb admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.617217 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67812ee-f1bd-4ed8-91dd-52da90715afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:15.619130 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67812ee-f1bd-4ed8-91dd-52da90715afb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:15.645610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1374/2741] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:18:15 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:15.646746 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf73e5-bcae-4e59-b86e-ee34edef18db admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:15.658820 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf73e5-bcae-4e59-b86e-ee34edef18db admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:15.663798 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901055d-91a1-4476-a9ce-f7dc9bae2c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:15.664525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901055d-91a1-4476-a9ce-f7dc9bae2c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.664813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901055d-91a1-4476-a9ce-f7dc9bae2c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.665092 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901055d-91a1-4476-a9ce-f7dc9bae2c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.665826 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901055d-91a1-4476-a9ce-f7dc9bae2c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:15.667445 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901055d-91a1-4476-a9ce-f7dc9bae2c3e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:15.680459 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1368/2742] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:18:15.684228 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67812ee-f1bd-4ed8-91dd-52da90715afb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:15.695354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67812ee-f1bd-4ed8-91dd-52da90715afb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:15.707379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822969b4-fc46-42ed-9e96-c820e5657b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:15.708568 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822969b4-fc46-42ed-9e96-c820e5657b6f admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.709546 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822969b4-fc46-42ed-9e96-c820e5657b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.710033 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822969b4-fc46-42ed-9e96-c820e5657b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.714189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822969b4-fc46-42ed-9e96-c820e5657b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:15.716079 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822969b4-fc46-42ed-9e96-c820e5657b6f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:15.728383 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1375/2743] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:15.733418 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901055d-91a1-4476-a9ce-f7dc9bae2c3e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:15.749627 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901055d-91a1-4476-a9ce-f7dc9bae2c3e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:15.754465 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d935f-4283-4b25-88a3-8199441c5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:15.755394 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d935f-4283-4b25-88a3-8199441c5031 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.755681 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d935f-4283-4b25-88a3-8199441c5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.755994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d935f-4283-4b25-88a3-8199441c5031 admin admin] PATH_INFO: `/v3/projects/a1a1964bc9f447e8bd058a0af90fd7a9/users/d89fafd2f5024e99a2f68da9503ac2ba/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.772473 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d935f-4283-4b25-88a3-8199441c5031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a1964bc9f447e8bd058a0af90fd7a9, user_id=d89fafd2f5024e99a2f68da9503ac2ba, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:15.775296 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d935f-4283-4b25-88a3-8199441c5031 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:15.806990 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1369/2744] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:15 2022] PUT /identity/v3/projects/a1a1964bc9f447e8bd058a0af90fd7a9/users/d89fafd2f5024e99a2f68da9503ac2ba/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:15.825942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d686-5fb0-480b-82e1-4bdb3b55cf52 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:15.826863 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d686-5fb0-480b-82e1-4bdb3b55cf52 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:15.827304 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d686-5fb0-480b-82e1-4bdb3b55cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:15.927626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3433d686-5fb0-480b-82e1-4bdb3b55cf52 None None] MFA Rules not processed for user `d89fafd2f5024e99a2f68da9503ac2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:15.927626 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3433d686-5fb0-480b-82e1-4bdb3b55cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:16.096612 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1376/2745] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 22:18:16.112199 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d935f-4283-4b25-88a3-8199441c5031 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:16.114329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-db2d935f-4283-4b25-88a3-8199441c5031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:16.277818 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d935f-4283-4b25-88a3-8199441c5031 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:16.290366 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855e3c-28af-4de1-9e2a-4e67dbaaf6ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7d9cfbbcd4068aa9241ffd694c631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:16.291972 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855e3c-28af-4de1-9e2a-4e67dbaaf6ea service glance] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:16.292910 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855e3c-28af-4de1-9e2a-4e67dbaaf6ea service glance] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:16.293696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855e3c-28af-4de1-9e2a-4e67dbaaf6ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:16.316845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25855e3c-28af-4de1-9e2a-4e67dbaaf6ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:16.322420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25855e3c-28af-4de1-9e2a-4e67dbaaf6ea service glance] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:16.348540 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1370/2746] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 22:18:24.412624 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9ab51-897a-498c-bd13-fc3eb78e41b4 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:24.413189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9ab51-897a-498c-bd13-fc3eb78e41b4 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:24.413189 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9ab51-897a-498c-bd13-fc3eb78e41b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:24.419979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:24.435414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-3bd9ab51-897a-498c-bd13-fc3eb78e41b4 None None] MFA Rules not processed for user `63cf0ef7c80d4527ae14a6db28bbbc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:24.435414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-3bd9ab51-897a-498c-bd13-fc3eb78e41b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:24.527804 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1377/2747] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 22:18:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:24.541582 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855e3c-28af-4de1-9e2a-4e67dbaaf6ea service glance] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:24.543189 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-25855e3c-28af-4de1-9e2a-4e67dbaaf6ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:24.636141 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855e3c-28af-4de1-9e2a-4e67dbaaf6ea service glance] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:24.638261 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c68d3-75b7-41f3-b0fb-a7fd0d07de49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2695a36b9b38450981588c31c2b9afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:24.638927 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c68d3-75b7-41f3-b0fb-a7fd0d07de49 service swift] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:24.640023 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c68d3-75b7-41f3-b0fb-a7fd0d07de49 service swift] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:24.640637 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c68d3-75b7-41f3-b0fb-a7fd0d07de49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:24.649929 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c68d3-75b7-41f3-b0fb-a7fd0d07de49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:24.651665 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c68d3-75b7-41f3-b0fb-a7fd0d07de49 service swift] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:24.661164 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1371/2748] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 22:18:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 22:18:34.520567 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=24 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:34.657686 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:42.273282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9ab51-897a-498c-bd13-fc3eb78e41b4 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:42.338959 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9ab51-897a-498c-bd13-fc3eb78e41b4 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:42.343650 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:42.344581 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:42.344869 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:42.345151 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] PATH_INFO: `/v3/users/d89fafd2f5024e99a2f68da9503ac2ba` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:42.346682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89fafd2f5024e99a2f68da9503ac2ba)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:42.348761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:42.401684 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89fafd2f5024e99a2f68da9503ac2ba'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:42.408917 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89fafd2f5024e99a2f68da9503ac2ba'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:42.409576 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89fafd2f5024e99a2f68da9503ac2ba'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:42.422801 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89fafd2f5024e99a2f68da9503ac2ba'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:42.423440 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89fafd2f5024e99a2f68da9503ac2ba'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:42.435938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1378/2749] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:18:42 2022] DELETE /identity/v3/users/d89fafd2f5024e99a2f68da9503ac2ba => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:42.440538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f3c30-52bf-4b72-a59d-0a664cedae60 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:42.441005 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f3c30-52bf-4b72-a59d-0a664cedae60 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:42.441129 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f3c30-52bf-4b72-a59d-0a664cedae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:42.460066 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4a8f3c30-52bf-4b72-a59d-0a664cedae60 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:42.461516 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4a8f3c30-52bf-4b72-a59d-0a664cedae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:42.520303 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1372/2750] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:42.530005 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:42.531398 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:42.587575 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa4f3-e5d0-44d2-a745-7ab7b331a15f admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:42.591180 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312696-96b4-4f93-8bd1-dc4ccdf37a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:42.591821 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312696-96b4-4f93-8bd1-dc4ccdf37a89 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:42.592136 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312696-96b4-4f93-8bd1-dc4ccdf37a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:42.592414 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312696-96b4-4f93-8bd1-dc4ccdf37a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:42.601809 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312696-96b4-4f93-8bd1-dc4ccdf37a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:42.603205 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312696-96b4-4f93-8bd1-dc4ccdf37a89 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:42.612653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1379/2751] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:42.892759 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f3c30-52bf-4b72-a59d-0a664cedae60 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:42.894555 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4a8f3c30-52bf-4b72-a59d-0a664cedae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:42.909114 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f3c30-52bf-4b72-a59d-0a664cedae60 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:42.916525 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:42.917455 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:42.917887 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:42.918419 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] PATH_INFO: `/v3/projects/a1a1964bc9f447e8bd058a0af90fd7a9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:42.921645 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a1964bc9f447e8bd058a0af90fd7a9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:42.923683 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:42.978326 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a1964bc9f447e8bd058a0af90fd7a9', 'request_id': 'req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:42.984670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a1964bc9f447e8bd058a0af90fd7a9', 'request_id': 'req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:42.993169 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a1964bc9f447e8bd058a0af90fd7a9', 'request_id': 'req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:43.004224 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] The token cache is being invalidate because project a1a1964bc9f447e8bd058a0af90fd7a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:43.004517 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:43.005160 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-f3ce798c-7bbf-4abb-a5c4-0581fb91d44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:43.006758 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1373/2752] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:42 2022] DELETE /identity/v3/projects/a1a1964bc9f447e8bd058a0af90fd7a9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:43.011989 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17209a-9371-407c-9e00-2a5dd393ee85 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.012243 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17209a-9371-407c-9e00-2a5dd393ee85 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.012548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17209a-9371-407c-9e00-2a5dd393ee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.031018 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-0f17209a-9371-407c-9e00-2a5dd393ee85 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:43.032256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0f17209a-9371-407c-9e00-2a5dd393ee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:43.049822 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:43.095435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1380/2753] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:43.104970 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b2d2b-4b9e-4f7a-85a6-0976d3c0e0ef None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.105329 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b2d2b-4b9e-4f7a-85a6-0976d3c0e0ef None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.105679 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b2d2b-4b9e-4f7a-85a6-0976d3c0e0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.127725 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-0f0b2d2b-4b9e-4f7a-85a6-0976d3c0e0ef None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:43.129024 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-0f0b2d2b-4b9e-4f7a-85a6-0976d3c0e0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:43.141284 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1374/2754] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:43.142469 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17209a-9371-407c-9e00-2a5dd393ee85 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:43.153957 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17209a-9371-407c-9e00-2a5dd393ee85 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:43.158645 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d9b74-ab4f-42f6-bbed-e3e6ca5c848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:43.159307 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d9b74-ab4f-42f6-bbed-e3e6ca5c848e admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.159595 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d9b74-ab4f-42f6-bbed-e3e6ca5c848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.159877 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d9b74-ab4f-42f6-bbed-e3e6ca5c848e admin admin] PATH_INFO: `/v3/domains` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.160634 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d9b74-ab4f-42f6-bbed-e3e6ca5c848e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80410) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:18:43.160942 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d9b74-ab4f-42f6-bbed-e3e6ca5c848e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:43.162532 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d9b74-ab4f-42f6-bbed-e3e6ca5c848e admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:43.178938 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1381/2755] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 22:18:43.180383 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b2d2b-4b9e-4f7a-85a6-0976d3c0e0ef None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:43.190278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b2d2b-4b9e-4f7a-85a6-0976d3c0e0ef None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:43.196414 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727baad-8492-4b66-9ea4-f1881b1d8e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:43.197241 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727baad-8492-4b66-9ea4-f1881b1d8e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.197529 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727baad-8492-4b66-9ea4-f1881b1d8e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.197806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727baad-8492-4b66-9ea4-f1881b1d8e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.198588 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727baad-8492-4b66-9ea4-f1881b1d8e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:43.200604 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727baad-8492-4b66-9ea4-f1881b1d8e28 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:43.228777 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1375/2756] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:18:43 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:18:43.238269 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d9b74-ab4f-42f6-bbed-e3e6ca5c848e admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:43.244207 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d9b74-ab4f-42f6-bbed-e3e6ca5c848e admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:43.308680 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ba34-f7fb-443f-af74-f6bea93227db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:43.309366 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ba34-f7fb-443f-af74-f6bea93227db admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.309702 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ba34-f7fb-443f-af74-f6bea93227db admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.309926 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ba34-f7fb-443f-af74-f6bea93227db admin admin] PATH_INFO: `/v3/users` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.310627 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74ba34-f7fb-443f-af74-f6bea93227db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:43.312744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74ba34-f7fb-443f-af74-f6bea93227db admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:43.335194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1382/2757] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:18:43 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:18:43.336562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727baad-8492-4b66-9ea4-f1881b1d8e28 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:43.347267 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727baad-8492-4b66-9ea4-f1881b1d8e28 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:43.353365 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e3538-063b-44b4-a20b-c85c83b542be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:43.354062 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e3538-063b-44b4-a20b-c85c83b542be admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.354428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e3538-063b-44b4-a20b-c85c83b542be admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.354658 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e3538-063b-44b4-a20b-c85c83b542be admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.355476 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e3538-063b-44b4-a20b-c85c83b542be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:43.357279 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e3538-063b-44b4-a20b-c85c83b542be admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:43.368513 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1376/2758] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:43.372623 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ba34-f7fb-443f-af74-f6bea93227db admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:43.382889 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ba34-f7fb-443f-af74-f6bea93227db admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:43.387465 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddbee8-2e7e-47f2-bd52-6fe48bfe1ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:43.388159 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddbee8-2e7e-47f2-bd52-6fe48bfe1ded admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.388448 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddbee8-2e7e-47f2-bd52-6fe48bfe1ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.388731 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddbee8-2e7e-47f2-bd52-6fe48bfe1ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.389451 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddbee8-2e7e-47f2-bd52-6fe48bfe1ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:43.391187 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddbee8-2e7e-47f2-bd52-6fe48bfe1ded admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:43.402083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1383/2759] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:18:43.406000 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e3538-063b-44b4-a20b-c85c83b542be admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:43.416514 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e3538-063b-44b4-a20b-c85c83b542be admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:43.421219 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79528-1a8f-495e-8d6c-62cea85bd5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:43.422108 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79528-1a8f-495e-8d6c-62cea85bd5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.422397 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79528-1a8f-495e-8d6c-62cea85bd5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.422678 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79528-1a8f-495e-8d6c-62cea85bd5a0 admin admin] PATH_INFO: `/v3/projects/23221c0fd41c40f5b568273614c14a07/users/4a426e07eb12475dab27f27654dc3d76/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.438481 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79528-1a8f-495e-8d6c-62cea85bd5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23221c0fd41c40f5b568273614c14a07, user_id=4a426e07eb12475dab27f27654dc3d76, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:43.441184 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79528-1a8f-495e-8d6c-62cea85bd5a0 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:43.454344 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1377/2760] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:18:43 2022] PUT /identity/v3/projects/23221c0fd41c40f5b568273614c14a07/users/4a426e07eb12475dab27f27654dc3d76/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:43.464784 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4464b-87f1-447e-9f13-387b92cfbae5 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.465084 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4464b-87f1-447e-9f13-387b92cfbae5 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.465369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4464b-87f1-447e-9f13-387b92cfbae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.492503 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-8eb4464b-87f1-447e-9f13-387b92cfbae5 None None] MFA Rules not processed for user `4a426e07eb12475dab27f27654dc3d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:43.493710 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8eb4464b-87f1-447e-9f13-387b92cfbae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:43.558134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1384/2761] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:43.569253 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79528-1a8f-495e-8d6c-62cea85bd5a0 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:43.571105 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-11c79528-1a8f-495e-8d6c-62cea85bd5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:43.593149 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:43.629235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79528-1a8f-495e-8d6c-62cea85bd5a0 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:43.633034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c4a1b-9660-467d-b3c6-246ec6f952f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:43.633670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c4a1b-9660-467d-b3c6-246ec6f952f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:43.633954 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c4a1b-9660-467d-b3c6-246ec6f952f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:43.634231 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c4a1b-9660-467d-b3c6-246ec6f952f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:43.642328 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c4a1b-9660-467d-b3c6-246ec6f952f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:43.643744 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c4a1b-9660-467d-b3c6-246ec6f952f2 service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:43.653069 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1378/2762] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:47.789208 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4464b-87f1-447e-9f13-387b92cfbae5 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:47.790610 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-8eb4464b-87f1-447e-9f13-387b92cfbae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:47.810369 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:47.858462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4464b-87f1-447e-9f13-387b92cfbae5 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:47.863167 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:47.864066 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:47.864354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:47.864632 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] PATH_INFO: `/v3/users/ac52afa4afcc4e69b51744f3555f7f22` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:47.865835 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac52afa4afcc4e69b51744f3555f7f22)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:47.867966 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:47.919515 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac52afa4afcc4e69b51744f3555f7f22'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:47.930102 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac52afa4afcc4e69b51744f3555f7f22'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:47.930730 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac52afa4afcc4e69b51744f3555f7f22'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:47.945740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac52afa4afcc4e69b51744f3555f7f22'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:47.946433 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac52afa4afcc4e69b51744f3555f7f22'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:47.958604 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1385/2763] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:18:47 2022] DELETE /identity/v3/users/ac52afa4afcc4e69b51744f3555f7f22 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:18:47.963251 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da235c4-2f79-4b6b-87c0-2157bc46c30e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:47.963721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da235c4-2f79-4b6b-87c0-2157bc46c30e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:47.963824 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da235c4-2f79-4b6b-87c0-2157bc46c30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:47.981936 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-4da235c4-2f79-4b6b-87c0-2157bc46c30e None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:47.983147 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4da235c4-2f79-4b6b-87c0-2157bc46c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:48.042874 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1379/2764] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:48.053128 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:48.055409 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:48.123384 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4738a-4f48-4b9c-92a5-6c0cc951559b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:48.125591 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041d207-7560-4b4d-881d-fbe00f669f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:48.126252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d207-7560-4b4d-881d-fbe00f669f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:48.126541 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d207-7560-4b4d-881d-fbe00f669f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:48.126825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d207-7560-4b4d-881d-fbe00f669f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:48.136870 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041d207-7560-4b4d-881d-fbe00f669f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:48.138277 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041d207-7560-4b4d-881d-fbe00f669f5c service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:48.148819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1386/2765] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:48.424914 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da235c4-2f79-4b6b-87c0-2157bc46c30e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:48.426354 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4da235c4-2f79-4b6b-87c0-2157bc46c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:48.441811 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da235c4-2f79-4b6b-87c0-2157bc46c30e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:48.448402 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:48.448945 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:48.449235 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:48.449509 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] PATH_INFO: `/v3/projects/6c7872ccb2544b3880b5f8e8d6ea44b9` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:48.450698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7872ccb2544b3880b5f8e8d6ea44b9)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:48.452994 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:48.502498 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7872ccb2544b3880b5f8e8d6ea44b9', 'request_id': 'req-7468aea4-14bf-4860-8fe6-2fb93ec8e550'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:48.509424 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7872ccb2544b3880b5f8e8d6ea44b9', 'request_id': 'req-7468aea4-14bf-4860-8fe6-2fb93ec8e550'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:48.517969 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7872ccb2544b3880b5f8e8d6ea44b9', 'request_id': 'req-7468aea4-14bf-4860-8fe6-2fb93ec8e550'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:48.529502 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] The token cache is being invalidate because project 6c7872ccb2544b3880b5f8e8d6ea44b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:48.529788 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:48.530442 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-7468aea4-14bf-4860-8fe6-2fb93ec8e550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:48.532051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1380/2766] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:48 2022] DELETE /identity/v3/projects/6c7872ccb2544b3880b5f8e8d6ea44b9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:53.376176 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041d207-7560-4b4d-881d-fbe00f669f5c service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:53.377574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9041d207-7560-4b4d-881d-fbe00f669f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:53.390842 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041d207-7560-4b4d-881d-fbe00f669f5c service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:53.429732 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:53.449913 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:53.450786 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:53.451072 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:53.451355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] PATH_INFO: `/v3/users/4a426e07eb12475dab27f27654dc3d76` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:53.452840 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a426e07eb12475dab27f27654dc3d76)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:53.454747 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:53.498484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a426e07eb12475dab27f27654dc3d76'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:53.505511 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a426e07eb12475dab27f27654dc3d76'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:53.506107 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a426e07eb12475dab27f27654dc3d76'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:53.517762 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a426e07eb12475dab27f27654dc3d76'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:53.518387 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a426e07eb12475dab27f27654dc3d76'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:53.530859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1387/2767] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:18:53 2022] DELETE /identity/v3/users/4a426e07eb12475dab27f27654dc3d76 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:18:53.535351 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71a8a2-882a-4606-99d6-b46a9a2d8d82 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:53.535828 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71a8a2-882a-4606-99d6-b46a9a2d8d82 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:53.535969 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71a8a2-882a-4606-99d6-b46a9a2d8d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:53.554192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-2c71a8a2-882a-4606-99d6-b46a9a2d8d82 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:18:53.555458 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2c71a8a2-882a-4606-99d6-b46a9a2d8d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:53.602861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:18:53.623269 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1381/2768] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:18:53.633633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:53.635036 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:53.692047 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99289e-87d8-4a62-82a2-f89e85370adb admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:53.695737 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc6a2a-5749-4394-80a3-8b780603ba3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:53.696477 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6a2a-5749-4394-80a3-8b780603ba3a service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:53.696765 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6a2a-5749-4394-80a3-8b780603ba3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:53.697046 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6a2a-5749-4394-80a3-8b780603ba3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:53.706282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6a2a-5749-4394-80a3-8b780603ba3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:53.707697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6a2a-5749-4394-80a3-8b780603ba3a service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:53.717331 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1388/2769] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:18:53.983623 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71a8a2-882a-4606-99d6-b46a9a2d8d82 None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:18:53.985070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-2c71a8a2-882a-4606-99d6-b46a9a2d8d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:18:53.997091 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71a8a2-882a-4606-99d6-b46a9a2d8d82 None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:18:54.001670 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:18:54.002530 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:18:54.002808 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:18:54.003080 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] PATH_INFO: `/v3/projects/23221c0fd41c40f5b568273614c14a07` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:18:54.004293 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23221c0fd41c40f5b568273614c14a07)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:18:54.006206 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:18:54.053205 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23221c0fd41c40f5b568273614c14a07', 'request_id': 'req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:54.059860 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23221c0fd41c40f5b568273614c14a07', 'request_id': 'req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:54.066942 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23221c0fd41c40f5b568273614c14a07', 'request_id': 'req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:54.078361 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] The token cache is being invalidate because project 23221c0fd41c40f5b568273614c14a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:18:54.078652 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:54.079275 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:18:54.080845 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1382/2770] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:18:53 2022] DELETE /identity/v3/projects/23221c0fd41c40f5b568273614c14a07 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:19:03.713213 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:04.075123 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:12.093241 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc6a2a-5749-4394-80a3-8b780603ba3a service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:12.101956 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc6a2a-5749-4394-80a3-8b780603ba3a service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:12.150199 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c284bee-c9d3-4db3-841b-3cb2d788d4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:12.150859 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c284bee-c9d3-4db3-841b-3cb2d788d4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:12.151145 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c284bee-c9d3-4db3-841b-3cb2d788d4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:12.151419 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c284bee-c9d3-4db3-841b-3cb2d788d4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:12.153220 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5c284bee-c9d3-4db3-841b-3cb2d788d4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:12.213969 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c284bee-c9d3-4db3-841b-3cb2d788d4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:12.215413 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c284bee-c9d3-4db3-841b-3cb2d788d4d4 service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:12.225194 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1389/2771] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:19:15.331037 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:15.332685 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:15.346926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566bf84-06b0-4f6a-b45d-098f4bfd0b46 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:15.351420 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:15.352474 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:15.353278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:15.353574 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] PATH_INFO: `/v3/users/71516217b1714e84bda9e584c97e84b8` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:15.354892 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] RBAC: Authorizing `identity:delete_user(user_id=71516217b1714e84bda9e584c97e84b8)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:15.356876 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:15.403348 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71516217b1714e84bda9e584c97e84b8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.410356 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71516217b1714e84bda9e584c97e84b8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.423060 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71516217b1714e84bda9e584c97e84b8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.423688 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71516217b1714e84bda9e584c97e84b8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.424309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b8f5871c-bca7-4a3b-b753-d1778b85253c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71516217b1714e84bda9e584c97e84b8'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.436181 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1383/2772] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:19:15 2022] DELETE /identity/v3/users/71516217b1714e84bda9e584c97e84b8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 22:19:15.611157 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c284bee-c9d3-4db3-841b-3cb2d788d4d4 service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:15.626825 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c284bee-c9d3-4db3-841b-3cb2d788d4d4 service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:15.684556 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:15.685416 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:15.685697 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:15.685971 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] PATH_INFO: `/v3/projects/ba1f09399f9e4692be9473ea7e87af6b` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:15.687134 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1f09399f9e4692be9473ea7e87af6b)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:15.689042 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:15.734611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1f09399f9e4692be9473ea7e87af6b', 'request_id': 'req-9843f177-d038-4afa-8226-5c7ec700451c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.736464 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:15.741636 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1f09399f9e4692be9473ea7e87af6b', 'request_id': 'req-9843f177-d038-4afa-8226-5c7ec700451c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.747817 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1f09399f9e4692be9473ea7e87af6b', 'request_id': 'req-9843f177-d038-4afa-8226-5c7ec700451c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.759706 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] The token cache is being invalidate because project ba1f09399f9e4692be9473ea7e87af6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80410) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:19:15.760019 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.760641 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-9843f177-d038-4afa-8226-5c7ec700451c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:15.762170 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1390/2773] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:19:15 2022] DELETE /identity/v3/projects/ba1f09399f9e4692be9473ea7e87af6b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:19:15.767220 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f4b0-106f-464a-9aad-28d811e65baf None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:15.767515 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f4b0-106f-464a-9aad-28d811e65baf None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:15.767799 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f4b0-106f-464a-9aad-28d811e65baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:15.786698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-5a12f4b0-106f-464a-9aad-28d811e65baf None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:19:15.787919 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5a12f4b0-106f-464a-9aad-28d811e65baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:15.850721 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1384/2774] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:19:15.858480 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e0d5-958c-495b-a935-f24a8b93ff4f None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:15.858771 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e0d5-958c-495b-a935-f24a8b93ff4f None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:15.859075 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e0d5-958c-495b-a935-f24a8b93ff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:15.877004 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-f6e8e0d5-958c-495b-a935-f24a8b93ff4f None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:19:15.878196 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-f6e8e0d5-958c-495b-a935-f24a8b93ff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:15.887073 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1391/2775] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:19:15.891638 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f4b0-106f-464a-9aad-28d811e65baf None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:15.901978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f4b0-106f-464a-9aad-28d811e65baf None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:15.906512 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ec3bd-2609-422a-91dc-d8ee31d543ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:15.907155 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ec3bd-2609-422a-91dc-d8ee31d543ad admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:15.907436 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ec3bd-2609-422a-91dc-d8ee31d543ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:15.907708 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ec3bd-2609-422a-91dc-d8ee31d543ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:15.908463 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ec3bd-2609-422a-91dc-d8ee31d543ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 22:19:15.908767 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ec3bd-2609-422a-91dc-d8ee31d543ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:15.910343 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ec3bd-2609-422a-91dc-d8ee31d543ad admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:15.921900 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1385/2776] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 22:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 22:19:15.926006 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8e0d5-958c-495b-a935-f24a8b93ff4f None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:15.935089 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8e0d5-958c-495b-a935-f24a8b93ff4f None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:15.939653 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0546c-4cd0-4ec0-bb5e-05539fd47f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:15.940326 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0546c-4cd0-4ec0-bb5e-05539fd47f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:15.940611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0546c-4cd0-4ec0-bb5e-05539fd47f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:15.940888 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0546c-4cd0-4ec0-bb5e-05539fd47f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:15.941579 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0546c-4cd0-4ec0-bb5e-05539fd47f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:15.943442 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0546c-4cd0-4ec0-bb5e-05539fd47f6a admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:15.969144 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1392/2777] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 22:19:15 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 22:19:15.973056 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ec3bd-2609-422a-91dc-d8ee31d543ad admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:15.983197 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ec3bd-2609-422a-91dc-d8ee31d543ad admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:16.042382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd10d4-e4e1-482f-9cc8-d1eb0a79b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:16.043059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd10d4-e4e1-482f-9cc8-d1eb0a79b11e admin admin] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:16.043347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd10d4-e4e1-482f-9cc8-d1eb0a79b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:16.043631 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd10d4-e4e1-482f-9cc8-d1eb0a79b11e admin admin] PATH_INFO: `/v3/users` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:16.044347 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd10d4-e4e1-482f-9cc8-d1eb0a79b11e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:16.046254 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd10d4-e4e1-482f-9cc8-d1eb0a79b11e admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:16.052926 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:16.071247 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1386/2778] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 22:19:15 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 22:19:16.073534 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0546c-4cd0-4ec0-bb5e-05539fd47f6a admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:16.084761 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0546c-4cd0-4ec0-bb5e-05539fd47f6a admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:16.089692 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aab2f-bb4e-4664-82f5-d93f1c6a7541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:16.090355 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aab2f-bb4e-4664-82f5-d93f1c6a7541 admin admin] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:16.090639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aab2f-bb4e-4664-82f5-d93f1c6a7541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:16.090916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aab2f-bb4e-4664-82f5-d93f1c6a7541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:16.091668 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aab2f-bb4e-4664-82f5-d93f1c6a7541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:16.093319 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aab2f-bb4e-4664-82f5-d93f1c6a7541 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:16.107615 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1393/2779] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 22:19:16.108789 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd10d4-e4e1-482f-9cc8-d1eb0a79b11e admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:16.121132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd10d4-e4e1-482f-9cc8-d1eb0a79b11e admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:16.126109 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b91e99-6653-438b-b10a-586a8e1ec7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:16.126881 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91e99-6653-438b-b10a-586a8e1ec7ed admin admin] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:16.127047 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91e99-6653-438b-b10a-586a8e1ec7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:16.127327 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91e99-6653-438b-b10a-586a8e1ec7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:16.128086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b91e99-6653-438b-b10a-586a8e1ec7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:16.129698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b91e99-6653-438b-b10a-586a8e1ec7ed admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:16.140483 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1387/2780] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 22:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 22:19:16.144616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aab2f-bb4e-4664-82f5-d93f1c6a7541 admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:16.155526 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aab2f-bb4e-4664-82f5-d93f1c6a7541 admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:16.160439 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d0f96-e104-4eac-9b9a-bbfd1f72649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:16.161365 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d0f96-e104-4eac-9b9a-bbfd1f72649b admin admin] REQUEST_METHOD: `PUT` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:16.161652 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d0f96-e104-4eac-9b9a-bbfd1f72649b admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:16.161931 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d0f96-e104-4eac-9b9a-bbfd1f72649b admin admin] PATH_INFO: `/v3/projects/3871eb52f8794f90a06d34e98334faa0/users/6fd2839649fa4c1f91d5c8f0b7157b22/roles/edfcc7d2aec44b54ab2c3f4809908b08` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:16.177672 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d0f96-e104-4eac-9b9a-bbfd1f72649b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3871eb52f8794f90a06d34e98334faa0, user_id=6fd2839649fa4c1f91d5c8f0b7157b22, role_id=edfcc7d2aec44b54ab2c3f4809908b08)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:16.180352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d0f96-e104-4eac-9b9a-bbfd1f72649b admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:16.192727 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1394/2781] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 22:19:16 2022] PUT /identity/v3/projects/3871eb52f8794f90a06d34e98334faa0/users/6fd2839649fa4c1f91d5c8f0b7157b22/roles/edfcc7d2aec44b54ab2c3f4809908b08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:19:16.197698 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e6951-6e2b-461f-accf-775939a09f42 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:16.197992 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e6951-6e2b-461f-accf-775939a09f42 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:16.198281 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e6951-6e2b-461f-accf-775939a09f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:16.217192 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b15e6951-6e2b-461f-accf-775939a09f42 None None] MFA Rules not processed for user `9a1c8175bf58440a96c9e02fcf618584`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:19:16.218390 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b15e6951-6e2b-461f-accf-775939a09f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:16.275760 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1388/2782] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:19:16.285548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d0f96-e104-4eac-9b9a-bbfd1f72649b admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:16.287256 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-141d0f96-e104-4eac-9b9a-bbfd1f72649b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:16.344053 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d0f96-e104-4eac-9b9a-bbfd1f72649b admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:16.347673 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399cd03-4179-40f5-b8ee-efca8957565c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:16.348352 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399cd03-4179-40f5-b8ee-efca8957565c service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:16.348638 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399cd03-4179-40f5-b8ee-efca8957565c service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:16.348920 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399cd03-4179-40f5-b8ee-efca8957565c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:16.358819 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399cd03-4179-40f5-b8ee-efca8957565c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:16.360240 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399cd03-4179-40f5-b8ee-efca8957565c service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:16.369675 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1395/2783] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:19:20.330006 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6710c91-ffff-4a34-a7f0-807c21cba9b4 None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:20.330534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6710c91-ffff-4a34-a7f0-807c21cba9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:20.330534 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6710c91-ffff-4a34-a7f0-807c21cba9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:20.363624 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-b6710c91-ffff-4a34-a7f0-807c21cba9b4 None None] MFA Rules not processed for user `6fd2839649fa4c1f91d5c8f0b7157b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:19:20.364977 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b6710c91-ffff-4a34-a7f0-807c21cba9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:20.446061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1389/2784] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:19:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:19:20.461452 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399cd03-4179-40f5-b8ee-efca8957565c service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:20.463799 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-d399cd03-4179-40f5-b8ee-efca8957565c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:20.541647 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399cd03-4179-40f5-b8ee-efca8957565c service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:20.547585 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb78f8-cf1a-4a93-81f3-76e46b33b560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:20.548335 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb78f8-cf1a-4a93-81f3-76e46b33b560 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:20.548620 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb78f8-cf1a-4a93-81f3-76e46b33b560 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:20.549048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb78f8-cf1a-4a93-81f3-76e46b33b560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:20.558616 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb78f8-cf1a-4a93-81f3-76e46b33b560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:20.560109 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb78f8-cf1a-4a93-81f3-76e46b33b560 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:20.569925 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1396/2785] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:19:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:19:21.849360 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0800-65d7-4369-afd4-22d3c5cc979e None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:21.849949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0800-65d7-4369-afd4-22d3c5cc979e None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:21.849949 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0800-65d7-4369-afd4-22d3c5cc979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:21.867522 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-49ef0800-65d7-4369-afd4-22d3c5cc979e None None] MFA Rules not processed for user `6fd2839649fa4c1f91d5c8f0b7157b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:19:21.869074 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-49ef0800-65d7-4369-afd4-22d3c5cc979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:21.876264 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1390/2786] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:19:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:19:22.498746 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb78f8-cf1a-4a93-81f3-76e46b33b560 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:22.500263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-9dbb78f8-cf1a-4a93-81f3-76e46b33b560 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:22.509021 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:22.513104 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb78f8-cf1a-4a93-81f3-76e46b33b560 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:22.518048 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2d646-df3e-4770-b6be-f0a317a99aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:22.518944 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2d646-df3e-4770-b6be-f0a317a99aef service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:22.520119 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2d646-df3e-4770-b6be-f0a317a99aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:22.521263 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2d646-df3e-4770-b6be-f0a317a99aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:22.524210 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-80a2d646-df3e-4770-b6be-f0a317a99aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:22.536484 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2d646-df3e-4770-b6be-f0a317a99aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:22.538188 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2d646-df3e-4770-b6be-f0a317a99aef service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:22.552252 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1397/2787] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:19:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:19:31.862451 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:32.544417 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=4 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:43.988132 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0800-65d7-4369-afd4-22d3c5cc979e None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:43.999063 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0800-65d7-4369-afd4-22d3c5cc979e None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:44.003010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd24c8a-bf40-4c10-a079-4f41d313208c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:44.003662 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd24c8a-bf40-4c10-a079-4f41d313208c service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:44.003983 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd24c8a-bf40-4c10-a079-4f41d313208c service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:44.004265 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd24c8a-bf40-4c10-a079-4f41d313208c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:44.006034 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1cd24c8a-bf40-4c10-a079-4f41d313208c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:44.066287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd24c8a-bf40-4c10-a079-4f41d313208c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:44.067720 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd24c8a-bf40-4c10-a079-4f41d313208c service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:44.077562 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1391/2788] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:19:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:19:44.906949 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2d646-df3e-4770-b6be-f0a317a99aef service neutron] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:44.931083 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2d646-df3e-4770-b6be-f0a317a99aef service neutron] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:44.939770 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e6d786ac4a40468794b18cfedfa730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:44.940472 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:44.940890 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:44.943361 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:44.945838 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:44.965979 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:44.967635 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:44.981574 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1398/2789] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:19:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:19:48.789861 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd24c8a-bf40-4c10-a079-4f41d313208c service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:48.799733 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd24c8a-bf40-4c10-a079-4f41d313208c service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:48.803388 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d7a15-f2df-4ca3-acc1-fa2f616052e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:48.804070 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7a15-f2df-4ca3-acc1-fa2f616052e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:48.804362 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7a15-f2df-4ca3-acc1-fa2f616052e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:48.804643 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7a15-f2df-4ca3-acc1-fa2f616052e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:48.806982 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-4c0d7a15-f2df-4ca3-acc1-fa2f616052e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:48.818874 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d7a15-f2df-4ca3-acc1-fa2f616052e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:48.820282 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d7a15-f2df-4ca3-acc1-fa2f616052e0 service neutron] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:48.831803 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1392/2790] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:19:54.974946 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=6 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:55.083548 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:55.085163 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:55.175682 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51325e-fbaf-447f-83b5-067c906ed135 service nova] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:55.180282 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:55.181141 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:55.181951 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:55.182227 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] PATH_INFO: `/v3/users/3c39b59b57064d398b15ba83cef56d9c` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:55.183462 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c39b59b57064d398b15ba83cef56d9c)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:55.185413 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:55.230164 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c39b59b57064d398b15ba83cef56d9c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.237412 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c39b59b57064d398b15ba83cef56d9c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.238061 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c39b59b57064d398b15ba83cef56d9c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.250744 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c39b59b57064d398b15ba83cef56d9c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.251382 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c39b59b57064d398b15ba83cef56d9c'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.264000 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1399/2791] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:19:55 2022] DELETE /identity/v3/users/3c39b59b57064d398b15ba83cef56d9c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:19:55.442248 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d7a15-f2df-4ca3-acc1-fa2f616052e0 service neutron] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:55.495545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d7a15-f2df-4ca3-acc1-fa2f616052e0 service neutron] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:55.550327 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:55.551188 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:55.551472 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:55.551750 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] PATH_INFO: `/v3/projects/8ed84dc50cdd49a3a194c3004c79d71d` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:55.554535 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed84dc50cdd49a3a194c3004c79d71d)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:55.557806 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:55.604477 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:55.605802 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed84dc50cdd49a3a194c3004c79d71d', 'request_id': 'req-d19564e0-23ad-40f6-881b-d6c8147c6fec'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.612595 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed84dc50cdd49a3a194c3004c79d71d', 'request_id': 'req-d19564e0-23ad-40f6-881b-d6c8147c6fec'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.621010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed84dc50cdd49a3a194c3004c79d71d', 'request_id': 'req-d19564e0-23ad-40f6-881b-d6c8147c6fec'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.631118 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] The token cache is being invalidate because project 8ed84dc50cdd49a3a194c3004c79d71d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:19:55.631401 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.632051 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.633571 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1393/2792] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:19:55 2022] DELETE /identity/v3/projects/8ed84dc50cdd49a3a194c3004c79d71d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:19:55.637752 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:55.639195 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:55.652427 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e4b7-98c5-4ee1-8c76-8f1fda6113df admin admin] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:55.708415 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:55.709458 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:55.709763 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:55.710023 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] PATH_INFO: `/v3/users/31be076be56a4cc6ae2ae5a8e7c36569` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:55.711209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31be076be56a4cc6ae2ae5a8e7c36569)` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:55.713306 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:55.725313 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:19:55.759916 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31be076be56a4cc6ae2ae5a8e7c36569'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.767619 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31be076be56a4cc6ae2ae5a8e7c36569'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.768402 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31be076be56a4cc6ae2ae5a8e7c36569'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.781640 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31be076be56a4cc6ae2ae5a8e7c36569'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.782379 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.notifications [None req-1882a2a7-9c6d-4953-af52-ee35a6997d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31be076be56a4cc6ae2ae5a8e7c36569'} {{(pid=80410) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:55.795274 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1400/2793] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 22:19:55 2022] DELETE /identity/v3/users/31be076be56a4cc6ae2ae5a8e7c36569 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:19:55.973696 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:19:55.975287 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:19:55.989382 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19564e0-23ad-40f6-881b-d6c8147c6fec admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:19:56.051309 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1c8175bf58440a96c9e02fcf618584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fccb2b976d33488897e5b5707f7da2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:19:56.052379 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:19:56.052736 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:19:56.053086 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] PATH_INFO: `/v3/projects/684a2687fe4541bf9cf0e47ecf56f827` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:19:56.054359 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684a2687fe4541bf9cf0e47ecf56f827)` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:19:56.056978 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:19:56.106440 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684a2687fe4541bf9cf0e47ecf56f827', 'request_id': 'req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:56.113133 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684a2687fe4541bf9cf0e47ecf56f827', 'request_id': 'req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:56.123174 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684a2687fe4541bf9cf0e47ecf56f827', 'request_id': 'req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0'} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:56.133592 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] The token cache is being invalidate because project 684a2687fe4541bf9cf0e47ecf56f827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 22:19:56.133951 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:56.135812 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.notifications [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 22:19:56.137668 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1394/2794] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 22:19:55 2022] DELETE /identity/v3/projects/684a2687fe4541bf9cf0e47ecf56f827 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 22:20:05.790973 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:20:06.130377 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:20:14.285903 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeddab7-0bfe-4429-a48e-cd6f44dd1af0 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:20:14.286356 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeddab7-0bfe-4429-a48e-cd6f44dd1af0 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:20:14.286473 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeddab7-0bfe-4429-a48e-cd6f44dd1af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:20:14.304563 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-cbeddab7-0bfe-4429-a48e-cd6f44dd1af0 None None] MFA Rules not processed for user `6fd2839649fa4c1f91d5c8f0b7157b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:20:14.305755 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-cbeddab7-0bfe-4429-a48e-cd6f44dd1af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:20:14.361740 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1401/2795] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:20:15.400061 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:20:15.401466 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:20:15.509183 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0a5ca-da34-454f-814e-f2dce05ba4e0 admin admin] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:20:15.515452 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:20:15.516137 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:20:15.516428 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:20:15.516710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:20:15.518475 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:20:15.530403 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:20:15.532010 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:20:15.542153 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1395/2796] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:20:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:20:24.355056 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=25 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:20:25.537706 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=48 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:21:14.323643 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7b7a-10d3-440b-816e-40fb4505e8b2 None None] REQUEST_METHOD: `POST` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:21:14.324253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7b7a-10d3-440b-816e-40fb4505e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:21:14.324253 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7b7a-10d3-440b-816e-40fb4505e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:21:14.343378 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.auth.core [None req-36aa7b7a-10d3-440b-816e-40fb4505e8b2 None None] MFA Rules not processed for user `6fd2839649fa4c1f91d5c8f0b7157b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80410) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:21:14.344611 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-36aa7b7a-10d3-440b-816e-40fb4505e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:21:14.351767 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1402/2797] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:21:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:21:24.337719 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=3 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:22:00.553249 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:22:00.554791 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:22:00.633385 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de08344-78c8-4334-9d84-358dad6ad351 service placement] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:22:00.637098 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926bac7-2a06-438e-9b07-f5b417636a6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:22:00.637772 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bac7-2a06-438e-9b07-f5b417636a6b service cinder] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:22:00.638059 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bac7-2a06-438e-9b07-f5b417636a6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:22:00.638340 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bac7-2a06-438e-9b07-f5b417636a6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:22:00.640209 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-5926bac7-2a06-438e-9b07-f5b417636a6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:22:00.728182 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926bac7-2a06-438e-9b07-f5b417636a6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:22:00.729538 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926bac7-2a06-438e-9b07-f5b417636a6b service cinder] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:22:00.750041 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1396/2798] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:22:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:22:02.187760 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7b7a-10d3-440b-816e-40fb4505e8b2 None None] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:22:02.189192 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-36aa7b7a-10d3-440b-816e-40fb4505e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:22:02.201146 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7b7a-10d3-440b-816e-40fb4505e8b2 None None] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:22:02.205374 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d929086ac74f1bb5f323cca822fbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:22:02.206013 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:22:02.206297 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:22:02.206572 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:22:02.208354 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:22:02.223433 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:22:02.224910 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:22:02.235891 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1403/2799] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:22:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:22:09.461058 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a4e5-9444-4d67-8424-7f0ec3926bbb None None] REQUEST_METHOD: `POST` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:22:09.461593 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a4e5-9444-4d67-8424-7f0ec3926bbb None None] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:22:09.461710 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a4e5-9444-4d67-8424-7f0ec3926bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:22:09.479749 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.auth.core [None req-7e58a4e5-9444-4d67-8424-7f0ec3926bbb None None] MFA Rules not processed for user `6fd2839649fa4c1f91d5c8f0b7157b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 22:22:09.480979 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7e58a4e5-9444-4d67-8424-7f0ec3926bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:22:09.488695 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1397/2800] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 22:22:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 22:22:12.231177 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=6 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:22:19.474789 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=78 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:23:10.028407 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] Authenticating user token {{(pid=80410) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:23:10.029945 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:23:10.110209 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b968bf6-4058-485c-9419-bf271f2b3ceb service cinder] Validating token access rules against request {{(pid=80410) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:23:10.114463 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1eb72-43d4-4550-a69a-438f5b02138e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb227a145fdd44319f5ccbe762409ebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80410) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:23:10.115142 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1eb72-43d4-4550-a69a-438f5b02138e service neutron] REQUEST_METHOD: `GET` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:23:10.115435 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1eb72-43d4-4550-a69a-438f5b02138e service neutron] SCRIPT_NAME: `/identity` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:23:10.115717 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1eb72-43d4-4550-a69a-438f5b02138e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80410) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:23:10.117633 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.fernet_utils [None req-15b1eb72-43d4-4550-a69a-438f5b02138e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80410) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:23:10.128226 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1eb72-43d4-4550-a69a-438f5b02138e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:23:10.129639 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1eb72-43d4-4550-a69a-438f5b02138e service neutron] RBAC: Authorization granted {{(pid=80410) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:23:10.137609 dv-cinder-799871-28-smb devstack@keystone.service[80410]: [pid: 80410|app: 0|req: 1404/2801] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:23:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:23:20.134038 dv-cinder-799871-28-smb devstack@keystone.service[80410]: DEBUG dbcounter [-] [80410] Writing DB stats keystone:SELECT=35 {{(pid=80410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 22:26:06.261405 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a4e5-9444-4d67-8424-7f0ec3926bbb None None] Authenticating user token {{(pid=80411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 22:26:06.262813 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.fernet_utils [None req-7e58a4e5-9444-4d67-8424-7f0ec3926bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 22:26:06.277646 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a4e5-9444-4d67-8424-7f0ec3926bbb None None] Validating token access rules against request {{(pid=80411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 22:26:06.282590 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a5eec-8447-44e5-a54d-06cd176bd978 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6827b3db547b58560a1d4f89e9c14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e14f6463d4f46b0b2a1dba49254cbad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 22:26:06.283278 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5eec-8447-44e5-a54d-06cd176bd978 service placement] REQUEST_METHOD: `GET` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 22:26:06.283545 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5eec-8447-44e5-a54d-06cd176bd978 service placement] SCRIPT_NAME: `/identity` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 22:26:06.283822 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5eec-8447-44e5-a54d-06cd176bd978 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 22:26:06.292564 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5eec-8447-44e5-a54d-06cd176bd978 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 22:26:06.294156 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5eec-8447-44e5-a54d-06cd176bd978 service placement] RBAC: Authorization granted {{(pid=80411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 22:26:06.304567 dv-cinder-799871-28-smb devstack@keystone.service[80411]: [pid: 80411|app: 0|req: 1398/2802] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 22:26:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 22:26:16.299770 dv-cinder-799871-28-smb devstack@keystone.service[80411]: DEBUG dbcounter [-] [80411] Writing DB stats keystone:SELECT=6 {{(pid=80411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}